Sep 05 11:26:36 devstack cinder-volume[76512]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 05 11:26:36 devstack cinder-volume[76512]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 05 11:26:36 devstack cinder-volume[76512]: we strongly recommend against using it for new projects. Sep 05 11:26:36 devstack cinder-volume[76512]: If you are already using Eventlet, we recommend migrating to a different Sep 05 11:26:36 devstack cinder-volume[76512]: framework. For more detail see Sep 05 11:26:36 devstack cinder-volume[76512]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 05 11:26:36 devstack cinder-volume[76512]: import eventlet # noqa Sep 05 11:26:39 devstack cinder-volume[76512]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76512) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 11:26:39 devstack cinder-volume[76512]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76512) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 11:26:39 devstack cinder-volume[76512]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76512) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 11:26:40 devstack cinder-volume[76512]: INFO dbcounter [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] Registered counter for database cinder Sep 05 11:26:40 devstack cinder-volume[76512]: DEBUG oslo_db.sqlalchemy.engines [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76512) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 11:26:40 devstack cinder-volume[76512]: DEBUG dbcounter [-] [76512] Writer thread running {{(pid=76512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 05 11:26:40 devstack cinder-volume[76512]: INFO cinder.rpc [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 05 11:26:40 devstack cinder-volume[76512]: INFO cinder.rpc [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 05 11:26:40 devstack cinder-volume[76512]: DEBUG oslo_db.sqlalchemy.engines [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76512) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 11:26:40 devstack cinder-volume[76512]: INFO cinder.volume.manager [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] Determined volume DB was empty at startup. Sep 05 11:26:40 devstack cinder-volume[76512]: DEBUG cinder.volume.manager [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76512) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 05 11:26:40 devstack cinder-volume[76512]: INFO cinder.volume.manager [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 05 11:26:40 devstack cinder-volume[76512]: WARNING stevedore.named [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 05 11:26:40 devstack cinder-volume[76512]: WARNING castellan.key_manager [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 11:26:40 devstack cinder-volume[76512]: WARNING cinder.keymgr.conf_key_mgr [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 11:26:40 devstack cinder-volume[76512]: DEBUG cinder.volume.drivers.lvm [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76512) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 05 11:26:40 devstack cinder-volume[76512]: DEBUG oslo_concurrency.processutils [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_concurrency.processutils [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] CMD "cinder-rtstool verify" returned: 0 in 0.442s {{(pid=76512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_db.sqlalchemy.engines [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76512) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 11:26:41 devstack cinder-volume[76512]: INFO cinder.rpc [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 05 11:26:41 devstack cinder-volume[76512]: INFO cinder.rpc [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 05 11:26:41 devstack cinder-volume[76512]: WARNING stevedore.named [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 05 11:26:41 devstack cinder-volume[76512]: WARNING castellan.key_manager [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 11:26:41 devstack cinder-volume[76512]: INFO cinder.volume.manager [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_db.sqlalchemy.engines [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76512) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 11:26:41 devstack cinder-volume[76512]: INFO oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] Starting 1 workers Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] Started child 76667 {{(pid=76512) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] Full set of CONF: {{(pid=76512) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 05 11:26:41 devstack cinder-volume[76667]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] ******************************************************************************** {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] Configuration options gathered from: {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] ================================================================================ {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] allow_availability_zone_fallback = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] allow_compression_on_image_upload = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] allowed_direct_url_schemes = [] {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] api_rate_limit = True {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] auth_strategy = keystone {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] az_cache_duration = 3600 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_availability_zone = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_host = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_name = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_stats_polling_interval = 60 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backup_api_class = cinder.backup.api.API {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backup_name_template = backup-%s {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backup_use_same_host = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backup_use_temp_snapshot = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] chap_password = **** {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] chap_username = {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cinder_internal_tenant_project_id = 8fb26e18715d4d3d915e02f4a340ebb6 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cinder_internal_tenant_user_id = a7df2bd72b4d4d828c2130bb9952cc6f {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cloned_volume_same_az = True {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cluster = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] compression_format = gzip {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] compute_api_class = cinder.compute.nova.API {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] config_dir = [] {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] config_source = [] {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] control_exchange = openstack {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] debug = True {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] default_availability_zone = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] default_group_type = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] default_volume_type = lvmdriver-1 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] disk_geometry = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] driver_client_cert = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] driver_client_cert_key = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] driver_data_namespace = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] driver_ssl_cert_path = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] driver_ssl_cert_verify = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] driver_use_ssl = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] enable_force_upload = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] enable_new_services = True {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] enable_unsupported_driver = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] enforce_multipath_for_image_xfer = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] filter_function = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] glance_api_insecure = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] glance_api_servers = ['http://192.168.122.95/image'] {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] glance_api_ssl_compression = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] glance_ca_certificates_file = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76667]: INFO cinder.volume.manager [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 05 11:26:41 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] glance_catalog_info = image:glance:publicURL {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] glance_certfile = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] glance_keyfile = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] glance_num_retries = 3 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] glance_request_timeout = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] goodness_function = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] graceful_shutdown_timeout = 5 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] group_api_class = cinder.group.api.API {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] host = devstack {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] image_compress_on_upload = True {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] image_conversion_address_space_limit = 1 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] image_conversion_cpu_limit = 60 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] image_conversion_disable = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] image_upload_use_cinder_backend = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] image_upload_use_internal_tenant = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] image_volume_cache_enabled = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] image_volume_cache_max_count = 0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] image_volume_cache_max_size_gb = 0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] init_host_max_objects_retrieval = 0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] instance_format = [instance: %(uuid)s] {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] iscsi_target_flags = {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] iscsi_write_cache = on {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] iser_helper = tgtadm {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] iser_ip_address = 192.168.122.95 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] iser_port = 3260 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] log_color = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] log_config_append = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] log_dir = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] log_file = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] log_options = True {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] log_rotate_interval = 1 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] log_rotate_interval_type = days {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] log_rotation_type = none {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] max_age = 0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] max_logfile_count = 30 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] max_logfile_size_mb = 200 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] max_over_subscription_ratio = 20.0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] message_reap_interval = 86400 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] message_ttl = 2592000 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] migration_create_volume_timeout_secs = 300 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] monkey_patch = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] monkey_patch_modules = [] {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] my_ip = 192.168.122.95 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] no_snapshot_gb_quota = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] num_iser_scan_tries = 3 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] num_shell_tries = 3 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] num_volume_device_scan_tries = 3 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] nvmeof_conn_info_version = 1 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] nvmet_ns_id = 10 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] nvmet_port_id = 1 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] osapi_max_limit = 1000 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] osapi_volume_ext_list = [] {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] osapi_volume_listen_port = 8776 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] osapi_volume_use_ssl = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] osapi_volume_workers = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] per_volume_size_limit = -1 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] periodic_fuzzy_delay = 60 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] periodic_interval = 60 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] public_endpoint = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] publish_errors = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] quota_backup_gigabytes = 1000 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] quota_backups = 10 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] quota_gigabytes = 1000 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] quota_groups = 10 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] quota_snapshots = 10 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] quota_volumes = 10 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] rate_limit_burst = 0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] rate_limit_except_level = CRITICAL {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] rate_limit_interval = 0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] reinit_driver_count = 3 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] replication_device = **** {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] report_discard_supported = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] report_interval = 120 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] reservation_clean_interval = 86400 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] reservation_expire = 86400 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] reserved_image_namespaces = [] {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] reserved_percentage = 0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] rpc_response_timeout = 120 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] run_external_periodic_tasks = True {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] scst_target_driver = iscsi {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] scst_target_iqn_name = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] service_down_time = 720 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] shell_completion = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] snapshot_name_template = snapshot-%s {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] snapshot_same_host = True {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] split_loggers = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] state_path = /opt/stack/data/cinder {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] storage_availability_zone = nova {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] storage_protocol = iSCSI {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] syslog_log_facility = LOG_USER {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] target_helper = lioadm {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] target_ip_address = 192.168.122.95 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] target_port = 3260 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] target_protocol = iscsi {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] target_secondary_ip_addresses = [] {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] trace_flags = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] transport_url = **** {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] until_refresh = 0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] use_chap_auth = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] use_default_quota_class = True {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] use_journal = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] use_json = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] use_multipath_for_image_xfer = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] use_stderr = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] use_syslog = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] verify_glance_signatures = enabled {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] volume_api_class = cinder.volume.api.API {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] volume_backend_name = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] volume_clear = zero {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] volume_clear_ionice = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] volume_clear_size = 0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] volume_copy_bps_limit = 0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] volume_dd_blocksize = 1M {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] volume_name_template = volume-%s {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] volume_service_inithost_offload = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] volume_usage_audit_period = month {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] zoning_mode = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_concurrency.disable_process_locking = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.auth_section = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.auth_type = password {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.auth_version = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.cache = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.certfile = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.include_service_catalog = True {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.insecure = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.interface = public {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.keyfile = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.memcache_password = **** {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.memcache_username = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.region_name = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.service_type = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.95/identity {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.backend = dogpile.cache.null {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.backend_argument = **** {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.backend_expiration_time = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.config_prefix = cache.oslo {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.debug_cache_backend = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.enable_retry_client = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.enable_socket_keepalive = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.enabled = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.expiration_time = 600 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.hashclient_retry_attempts = 2 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.memcache_dead_retry = 300 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack sudo[76675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 05 11:26:41 devstack sudo[76675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.memcache_pool_maxsize = 10 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.memcache_sasl_enabled = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.password = **** {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.proxies = [] {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.redis_db = 0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.redis_server = localhost:6379 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.retry_attempts = 2 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.retry_delay = 0.0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.socket_keepalive_count = 1 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.socket_keepalive_idle = 1 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.socket_keepalive_interval = 1 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.socket_timeout = 1.0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.tls_allowed_ciphers = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.tls_cafile = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.tls_certfile = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.tls_enabled = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.tls_keyfile = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cache.username = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] coordination.backend_url = **** {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] database.asyncio_connection = **** {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] database.asyncio_slave_connection = **** {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] database.backend = sqlalchemy {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] database.connection = **** {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] database.connection_debug = 0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] database.connection_parameters = {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] database.connection_recycle_time = 3600 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] database.connection_trace = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] database.db_inc_retry_interval = True {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] database.db_max_retries = 20 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] database.db_max_retry_interval = 10 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] database.db_retry_interval = 1 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] database.max_overflow = 50 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] database.max_pool_size = 5 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] database.max_retries = 10 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] database.mysql_wsrep_sync_wait = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] database.pool_timeout = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] database.retry_interval = 10 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] database.slave_connection = **** {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] database.sqlite_synchronous = True {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] database.synchronous_reader = True {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] database.use_db_reconnect = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_tracing.insecure = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] profiler.connection_string = messaging:// {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] profiler.enabled = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] profiler.es_doc_type = notification {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] profiler.es_scroll_size = 10000 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] profiler.es_scroll_time = 2m {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] profiler.filter_error_trace = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] profiler.hmac_keys = **** {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] profiler.sentinel_service_name = mymaster {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] profiler.socket_timeout = 0.1 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] profiler.trace_requests = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] profiler.trace_sqlalchemy = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] profiler_jaeger.process_tags = {} {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] profiler_jaeger.service_name_prefix = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] profiler_otlp.service_name_prefix = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_policy.enforce_new_defaults = True {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_policy.policy_default_rule = default {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_policy.policy_file = policy.yaml {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] privsep_osbrick.group = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] privsep_osbrick.helper_command = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] privsep_osbrick.user = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cinder_sys_admin.group = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cinder_sys_admin.helper_command = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] cinder_sys_admin.user = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] service_user.auth_section = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] service_user.auth_type = password {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] service_user.cafile = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] service_user.certfile = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] service_user.collect_timing = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] service_user.insecure = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] service_user.keyfile = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] service_user.send_service_user_token = True {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] service_user.split_loggers = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] service_user.timeout = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] service_user.tls_ciphers = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] service_user.tls_min_version = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] glance.auth_section = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] glance.auth_type = password {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] glance.certfile = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] glance.collect_timing = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] glance.insecure = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] glance.keyfile = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] glance.region_name = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] glance.split_loggers = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] glance.timeout = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] glance.tls_ciphers = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] glance.tls_min_version = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.backend_availability_zone = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.chap_password = **** {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.chap_username = {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.disk_geometry = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.driver_client_cert = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.driver_client_cert_key = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.driver_data_namespace = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.driver_use_ssl = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.extra_capabilities = {} {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.filter_function = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.goodness_function = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.iscsi_target_flags = {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.iscsi_write_cache = on {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.iser_helper = tgtadm {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.iser_ip_address = 192.168.122.95 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.iser_port = 3260 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.lvm_share_target = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.lvm_type = auto {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.num_shell_tries = 3 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.replication_device = **** {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.report_discard_supported = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.reserved_percentage = 0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.target_helper = tgtadm {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.target_ip_address = 192.168.122.95 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.target_port = 3260 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.target_protocol = iscsi {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.trace_flags = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.unique_fqdn_network = True {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.use_chap_auth = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.volume_backend_name = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.volume_clear = zero {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.volume_clear_ionice = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.volume_clear_size = 0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_reports.file_event_handler = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_reports.log_dir = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.backend_host = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.chap_password = **** {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.chap_username = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.disk_geometry = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.driver_client_cert = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.extra_capabilities = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.filter_function = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.goodness_function = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.iser_helper = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.iser_ip_address = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.iser_port = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.lvm_share_target = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.lvm_type = auto {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.num_shell_tries = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.replication_device = **** {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.report_discard_supported = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.reserved_percentage = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.scst_target_driver = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.storage_protocol = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.target_helper = lioadm {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.target_ip_address = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.target_port = 3260 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.trace_flags = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.use_chap_auth = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.volume_clear = zero {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.volume_clear_size = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] lvmdriver-1.volumes_dir = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.ssl = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_notifications.driver = [] {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_notifications.retry = -1 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] key_manager.fixed_key = **** {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] barbican.barbican_api_version = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] barbican.barbican_endpoint = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] barbican.barbican_endpoint_type = public {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] barbican.barbican_region_name = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] barbican.cafile = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] barbican.certfile = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] barbican.collect_timing = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] barbican.insecure = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] barbican.keyfile = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] barbican.number_of_retries = 60 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] barbican.retry_delay = 1 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] barbican.send_service_user_token = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] barbican.split_loggers = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] barbican.timeout = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] barbican.tls_ciphers = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] barbican.tls_min_version = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] barbican.verify_ssl = True {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] barbican.verify_ssl_path = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] barbican_service_user.auth_section = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] barbican_service_user.auth_type = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] barbican_service_user.cafile = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] barbican_service_user.certfile = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] barbican_service_user.collect_timing = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] barbican_service_user.insecure = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] barbican_service_user.keyfile = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] barbican_service_user.split_loggers = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] barbican_service_user.timeout = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] barbican_service_user.tls_ciphers = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] barbican_service_user.tls_min_version = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] vault.approle_role_id = **** {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] vault.approle_secret_id = **** {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] vault.auth_method = approle {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] vault.auth_path = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] vault.kv_mountpoint = secret {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] vault.kv_path = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] vault.kv_version = 2 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] vault.namespace = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] vault.root_token_id = **** {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] vault.ssl_ca_crt_file = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] vault.timeout = 60.0 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] vault.token_file = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] vault.token_role = None {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] vault.use_ssl = False {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:26:41 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] ******************************************************************************** {{(pid=76512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 05 11:26:41 devstack sudo[76675]: pam_unix(sudo:session): session closed for user root Sep 05 11:26:41 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:41 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:41 devstack sudo[76698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 11:26:41 devstack sudo[76698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:26:42 devstack sudo[76698]: pam_unix(sudo:session): session closed for user root Sep 05 11:26:42 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.373s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:42 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 11:26:42 devstack cinder-volume[76667]: INFO cinder.brick.local_dev.lvm [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 05 11:26:42 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:42 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:42 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:42 devstack sudo[76822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 11:26:42 devstack sudo[76822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:26:42 devstack sudo[76822]: pam_unix(sudo:session): session closed for user root Sep 05 11:26:42 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:42 devstack cinder-volume[76667]: DEBUG cinder.brick.local_dev.lvm [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76667) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 05 11:26:42 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:42 devstack sudo[76903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 11:26:42 devstack sudo[76903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:26:43 devstack sudo[76903]: pam_unix(sudo:session): session closed for user root Sep 05 11:26:43 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.505s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:43 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:43 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:43 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:43 devstack sudo[77081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 11:26:43 devstack sudo[77081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:26:43 devstack sudo[77081]: pam_unix(sudo:session): session closed for user root Sep 05 11:26:43 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:43 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:43 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:43 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:43 devstack sudo[77191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 05 11:26:43 devstack sudo[77191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:26:43 devstack sudo[77191]: pam_unix(sudo:session): session closed for user root Sep 05 11:26:43 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.319s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:43 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:43 devstack sudo[77285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 11:26:43 devstack sudo[77285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:26:44 devstack sudo[77285]: pam_unix(sudo:session): session closed for user root Sep 05 11:26:44 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:44 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:44 devstack sudo[77288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 11:26:44 devstack sudo[77288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:26:44 devstack sudo[77288]: pam_unix(sudo:session): session closed for user root Sep 05 11:26:44 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.378s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:44 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:44 devstack sudo[77372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 11:26:44 devstack sudo[77372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:26:44 devstack sudo[77372]: pam_unix(sudo:session): session closed for user root Sep 05 11:26:44 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:44 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:44 devstack sudo[77375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 11:26:44 devstack sudo[77375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:26:44 devstack sudo[77375]: pam_unix(sudo:session): session closed for user root Sep 05 11:26:44 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:44 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:44 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:44 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:44 devstack sudo[77445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 11:26:44 devstack sudo[77445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:26:45 devstack sudo[77445]: pam_unix(sudo:session): session closed for user root Sep 05 11:26:45 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.309s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:45 devstack cinder-volume[76667]: INFO cinder.volume.drivers.lvm [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 05 11:26:45 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:45 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:45 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:45 devstack sudo[77475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 11:26:45 devstack sudo[77475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:26:45 devstack sudo[77475]: pam_unix(sudo:session): session closed for user root Sep 05 11:26:45 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.291s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:45 devstack cinder-volume[76667]: DEBUG cinder.volume.drivers.lvm [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Updating volume stats {{(pid=76667) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 11:26:45 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:45 devstack sudo[77478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 11:26:45 devstack sudo[77478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:26:45 devstack sudo[77478]: pam_unix(sudo:session): session closed for user root Sep 05 11:26:45 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:45 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:45 devstack sudo[77481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 11:26:45 devstack sudo[77481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:26:46 devstack sudo[77481]: pam_unix(sudo:session): session closed for user root Sep 05 11:26:46 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:46 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:46 devstack sudo[77484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 11:26:46 devstack sudo[77484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:26:46 devstack sudo[77484]: pam_unix(sudo:session): session closed for user root Sep 05 11:26:46 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.305s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:46 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:46 devstack sudo[77488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 11:26:46 devstack sudo[77488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:26:46 devstack sudo[77488]: pam_unix(sudo:session): session closed for user root Sep 05 11:26:46 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.311s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:46 devstack cinder-volume[76667]: INFO cinder.volume.driver [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Driver hasn't implemented _init_vendor_properties() Sep 05 11:26:46 devstack cinder-volume[76667]: DEBUG cinder.volume.driver [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76667) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 05 11:26:46 devstack cinder-volume[76667]: DEBUG oslo_db.sqlalchemy.engines [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76667) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 11:26:46 devstack cinder-volume[76667]: DEBUG dbcounter [-] [76667] Writer thread running {{(pid=76667) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 05 11:26:46 devstack cinder-volume[76667]: DEBUG cinder.db.api [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Building query based on filter {{(pid=76667) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 05 11:26:46 devstack cinder-volume[76667]: DEBUG cinder.image.image_utils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76667) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 05 11:26:46 devstack cinder-volume[76667]: INFO cinder.keymgr.migration [None req-c81c16c7-adf9-46ae-8035-d888139507a3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 05 11:26:46 devstack cinder-volume[76667]: DEBUG cinder.volume.drivers.lvm [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Updating volume stats {{(pid=76667) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 11:26:46 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:46 devstack sudo[77491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 11:26:46 devstack sudo[77491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:26:47 devstack sudo[77491]: pam_unix(sudo:session): session closed for user root Sep 05 11:26:47 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.310s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:47 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:47 devstack sudo[77495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 11:26:47 devstack sudo[77495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:26:47 devstack sudo[77495]: pam_unix(sudo:session): session closed for user root Sep 05 11:26:47 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:47 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:47 devstack sudo[77500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 11:26:47 devstack sudo[77500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:26:47 devstack sudo[77500]: pam_unix(sudo:session): session closed for user root Sep 05 11:26:47 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:47 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:47 devstack sudo[77503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 11:26:47 devstack sudo[77503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:26:48 devstack sudo[77503]: pam_unix(sudo:session): session closed for user root Sep 05 11:26:48 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:48 devstack cinder-volume[76667]: DEBUG cinder.manager [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Notifying Schedulers of capabilities ... {{(pid=76667) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:26:48 devstack cinder-volume[76667]: INFO cinder.volume.manager [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Driver initialization completed successfully. Sep 05 11:26:48 devstack cinder-volume[76667]: INFO cinder.manager [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Initiating service 2 cleanup Sep 05 11:26:48 devstack cinder-volume[76667]: INFO cinder.manager [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Service 2 cleanup completed. Sep 05 11:26:48 devstack cinder-volume[76667]: DEBUG cinder.service [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Creating RPC server for service cinder-volume {{(pid=76667) start /opt/stack/cinder/cinder/service.py:231}} Sep 05 11:26:48 devstack cinder-volume[76667]: DEBUG cinder.service [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76667) start /opt/stack/cinder/cinder/service.py:237}} Sep 05 11:26:48 devstack cinder-volume[76667]: INFO cinder.volume.manager [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 05 11:26:48 devstack cinder-volume[76667]: DEBUG cinder.volume.drivers.lvm [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Updating volume stats {{(pid=76667) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 11:26:48 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:48 devstack sudo[77506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 11:26:48 devstack sudo[77506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:26:48 devstack sudo[77506]: pam_unix(sudo:session): session closed for user root Sep 05 11:26:48 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:48 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:48 devstack sudo[77514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 11:26:48 devstack sudo[77514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:26:48 devstack sudo[77514]: pam_unix(sudo:session): session closed for user root Sep 05 11:26:48 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:48 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:48 devstack sudo[77517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 11:26:48 devstack sudo[77517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:26:49 devstack sudo[77517]: pam_unix(sudo:session): session closed for user root Sep 05 11:26:49 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:49 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:26:49 devstack sudo[77520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 11:26:49 devstack sudo[77520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:26:49 devstack sudo[77520]: pam_unix(sudo:session): session closed for user root Sep 05 11:26:49 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:26:49 devstack cinder-volume[76667]: INFO cinder.volume.manager [None req-256fa1fc-46a5-4ee1-ad4b-78468327f615 None None] Driver post RPC initialization completed successfully. Sep 05 11:26:51 devstack cinder-volume[76512]: DEBUG dbcounter [-] [76512] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:26:58 devstack cinder-volume[76667]: DEBUG dbcounter [-] [76667] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76667) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:26:59 devstack cinder-volume[76667]: DEBUG dbcounter [-] [76667] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=76667) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:27:43 devstack cinder-volume[76667]: DEBUG oslo_service.periodic_task [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76667) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:27:43 devstack cinder-volume[76667]: DEBUG cinder.volume.drivers.lvm [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] Updating volume stats {{(pid=76667) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 11:27:43 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:27:43 devstack sudo[79494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 11:27:43 devstack sudo[79494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:27:43 devstack sudo[79494]: pam_unix(sudo:session): session closed for user root Sep 05 11:27:43 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:27:43 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:27:43 devstack sudo[79497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 11:27:43 devstack sudo[79497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:27:43 devstack sudo[79497]: pam_unix(sudo:session): session closed for user root Sep 05 11:27:43 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:27:43 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:27:43 devstack sudo[79500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 11:27:43 devstack sudo[79500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:27:44 devstack sudo[79500]: pam_unix(sudo:session): session closed for user root Sep 05 11:27:44 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:27:44 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:27:44 devstack sudo[79503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 11:27:44 devstack sudo[79503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:27:44 devstack sudo[79503]: pam_unix(sudo:session): session closed for user root Sep 05 11:27:44 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:27:44 devstack cinder-volume[76667]: DEBUG cinder.manager [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] Notifying Schedulers of capabilities ... {{(pid=76667) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:27:44 devstack cinder-volume[76667]: DEBUG oslo_service.periodic_task [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] Running periodic task VolumeManager._thread_info {{(pid=76667) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:27:44 devstack cinder-volume[76667]: DEBUG cinder.volume.manager [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] thread count: 6 {{(pid=76667) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 11:27:44 devstack cinder-volume[76667]: DEBUG cinder.volume.manager [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] thread info: [<_MainThread(MainThread, started 123906991038592)>, , , , , ] {{(pid=76667) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 11:28:43 devstack cinder-volume[76667]: DEBUG oslo_service.periodic_task [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76667) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:28:43 devstack cinder-volume[76667]: DEBUG cinder.volume.drivers.lvm [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] Updating volume stats {{(pid=76667) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 11:28:43 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:28:43 devstack sudo[82798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 11:28:43 devstack sudo[82798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:28:43 devstack sudo[82798]: pam_unix(sudo:session): session closed for user root Sep 05 11:28:43 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:28:43 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:28:43 devstack sudo[82802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 11:28:43 devstack sudo[82802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:28:43 devstack sudo[82802]: pam_unix(sudo:session): session closed for user root Sep 05 11:28:43 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:28:43 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:28:43 devstack sudo[82809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 11:28:43 devstack sudo[82809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:28:44 devstack sudo[82809]: pam_unix(sudo:session): session closed for user root Sep 05 11:28:44 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:28:44 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:28:44 devstack sudo[82813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 11:28:44 devstack sudo[82813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:28:44 devstack sudo[82813]: pam_unix(sudo:session): session closed for user root Sep 05 11:28:44 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:28:44 devstack cinder-volume[76667]: DEBUG cinder.manager [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] Notifying Schedulers of capabilities ... {{(pid=76667) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:28:59 devstack cinder-volume[76667]: DEBUG dbcounter [-] [76667] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76667) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:29:43 devstack cinder-volume[76667]: DEBUG oslo_service.periodic_task [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76667) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:29:43 devstack cinder-volume[76667]: DEBUG cinder.volume.drivers.lvm [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] Updating volume stats {{(pid=76667) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 11:29:43 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:29:43 devstack sudo[84777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 11:29:43 devstack sudo[84777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:29:43 devstack sudo[84777]: pam_unix(sudo:session): session closed for user root Sep 05 11:29:43 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:29:43 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:29:43 devstack sudo[84786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 11:29:43 devstack sudo[84786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:29:43 devstack sudo[84786]: pam_unix(sudo:session): session closed for user root Sep 05 11:29:43 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:29:43 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:29:43 devstack sudo[84795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 11:29:43 devstack sudo[84795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:29:44 devstack sudo[84795]: pam_unix(sudo:session): session closed for user root Sep 05 11:29:44 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:29:44 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:29:44 devstack sudo[84812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 11:29:44 devstack sudo[84812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:29:44 devstack sudo[84812]: pam_unix(sudo:session): session closed for user root Sep 05 11:29:44 devstack cinder-volume[76667]: DEBUG oslo_concurrency.processutils [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76667) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:29:44 devstack cinder-volume[76667]: DEBUG cinder.manager [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] Notifying Schedulers of capabilities ... {{(pid=76667) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:29:44 devstack cinder-volume[76667]: DEBUG oslo_service.periodic_task [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] Running periodic task VolumeManager._thread_info {{(pid=76667) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:29:44 devstack cinder-volume[76667]: DEBUG cinder.volume.manager [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] thread count: 6 {{(pid=76667) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 11:29:44 devstack cinder-volume[76667]: DEBUG cinder.volume.manager [None req-9398b78f-3733-4ec9-b68e-5db1ec4389fb None None] thread info: [<_MainThread(MainThread, started 123906991038592)>, , , , , ] {{(pid=76667) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 11:30:59 devstack cinder-volume[76667]: DEBUG dbcounter [-] [76667] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76667) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:31:01 devstack cinder-volume[76512]: INFO oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] Caught SIGTERM, stopping children Sep 05 11:31:01 devstack cinder-volume[76512]: DEBUG oslo_concurrency.lockutils [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] Acquiring lock "singleton_lock" {{(pid=76512) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 11:31:01 devstack cinder-volume[76512]: DEBUG oslo_concurrency.lockutils [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] Acquired lock "singleton_lock" {{(pid=76512) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 11:31:01 devstack cinder-volume[76512]: DEBUG oslo_concurrency.lockutils [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] Releasing lock "singleton_lock" {{(pid=76512) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 11:31:01 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] Stop services. {{(pid=76512) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 05 11:31:01 devstack cinder-volume[76512]: DEBUG oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] Killing children. {{(pid=76512) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 05 11:31:01 devstack cinder-volume[76512]: INFO oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] Waiting on 1 children to exit Sep 05 11:31:03 devstack cinder-volume[76667]: DEBUG oslo_concurrency.lockutils [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] Acquiring lock "singleton_lock" {{(pid=76667) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 11:31:03 devstack cinder-volume[76667]: DEBUG oslo_concurrency.lockutils [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] Acquired lock "singleton_lock" {{(pid=76667) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 11:31:03 devstack cinder-volume[76667]: DEBUG oslo_concurrency.lockutils [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] Releasing lock "singleton_lock" {{(pid=76667) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 11:31:03 devstack cinder-volume[76667]: WARNING amqp [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 05 11:31:03 devstack cinder-volume[76667]: WARNING amqp [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 05 11:31:03 devstack cinder-volume[76512]: INFO oslo_service.backend._eventlet.service [None req-13144e00-6a6f-49d8-97a1-4ea032010721 None None] Child 76667 exited with status 0 Sep 05 11:31:03 devstack cinder-volume[86656]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 05 11:31:03 devstack cinder-volume[86656]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 05 11:31:03 devstack cinder-volume[86656]: we strongly recommend against using it for new projects. Sep 05 11:31:03 devstack cinder-volume[86656]: If you are already using Eventlet, we recommend migrating to a different Sep 05 11:31:03 devstack cinder-volume[86656]: framework. For more detail see Sep 05 11:31:03 devstack cinder-volume[86656]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 05 11:31:03 devstack cinder-volume[86656]: import eventlet # noqa Sep 05 11:31:05 devstack cinder-volume[86656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86656) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 11:31:05 devstack cinder-volume[86656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86656) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 11:31:05 devstack cinder-volume[86656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86656) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 11:31:06 devstack cinder-volume[86656]: INFO dbcounter [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] Registered counter for database cinder Sep 05 11:31:06 devstack cinder-volume[86656]: DEBUG oslo_db.sqlalchemy.engines [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86656) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 11:31:06 devstack cinder-volume[86656]: DEBUG dbcounter [-] [86656] Writer thread running {{(pid=86656) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 05 11:31:06 devstack cinder-volume[86656]: INFO cinder.rpc [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 05 11:31:06 devstack cinder-volume[86656]: INFO cinder.rpc [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 05 11:31:06 devstack cinder-volume[86656]: DEBUG oslo_db.sqlalchemy.engines [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86656) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 11:31:06 devstack cinder-volume[86656]: INFO cinder.volume.manager [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] Determined volume DB was empty at startup. Sep 05 11:31:06 devstack cinder-volume[86656]: DEBUG cinder.volume.manager [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86656) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 05 11:31:06 devstack cinder-volume[86656]: INFO cinder.volume.manager [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 05 11:31:06 devstack cinder-volume[86656]: WARNING stevedore.named [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 05 11:31:06 devstack cinder-volume[86656]: WARNING castellan.key_manager [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 11:31:06 devstack cinder-volume[86656]: WARNING cinder.keymgr.conf_key_mgr [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 11:31:06 devstack cinder-volume[86656]: INFO cinder.volume.manager [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 05 11:31:06 devstack cinder-volume[86656]: DEBUG oslo_db.sqlalchemy.engines [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86656) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 11:31:06 devstack cinder-volume[86656]: INFO oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] Starting 1 workers Sep 05 11:31:06 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] Started child 86872 {{(pid=86656) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 05 11:31:06 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] Full set of CONF: {{(pid=86656) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 05 11:31:06 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] ******************************************************************************** {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 05 11:31:06 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] Configuration options gathered from: {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 05 11:31:06 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 05 11:31:06 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 05 11:31:06 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] ================================================================================ {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] allow_availability_zone_fallback = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] allow_compression_on_image_upload = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] allowed_direct_url_schemes = [] {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] api_rate_limit = True {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] auth_strategy = keystone {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_availability_zone = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_host = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86872]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_name = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_stats_polling_interval = 60 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backup_api_class = cinder.backup.api.API {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backup_name_template = backup-%s {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backup_use_same_host = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backup_use_temp_snapshot = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] chap_password = **** {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] chap_username = {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cinder_internal_tenant_project_id = 8fb26e18715d4d3d915e02f4a340ebb6 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cinder_internal_tenant_user_id = a7df2bd72b4d4d828c2130bb9952cc6f {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cluster = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] compression_format = gzip {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] compute_api_class = cinder.compute.nova.API {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] config_dir = [] {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] config_source = [] {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] control_exchange = openstack {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] debug = True {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] default_availability_zone = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] default_group_type = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] default_volume_type = QuobyteHD {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] disk_geometry = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] driver_client_cert = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] driver_client_cert_key = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] driver_data_namespace = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] driver_ssl_cert_path = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] driver_ssl_cert_verify = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] driver_use_ssl = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] enable_new_services = True {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] enable_unsupported_driver = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] enabled_backends = ['QuobyteHD'] {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] enforce_multipath_for_image_xfer = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] filter_function = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] glance_api_insecure = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] glance_api_servers = ['http://192.168.122.95/image'] {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] glance_api_ssl_compression = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] glance_ca_certificates_file = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] glance_catalog_info = image:glance:publicURL {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] glance_certfile = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] glance_keyfile = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] glance_num_retries = 3 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] glance_request_timeout = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] goodness_function = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] graceful_shutdown_timeout = 5 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] group_api_class = cinder.group.api.API {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] host = devstack {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] image_compress_on_upload = True {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] image_conversion_address_space_limit = 1 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] image_conversion_cpu_limit = 60 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] image_conversion_disable = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] image_upload_use_cinder_backend = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] image_upload_use_internal_tenant = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] image_volume_cache_enabled = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] image_volume_cache_max_count = 0 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] image_volume_cache_max_size_gb = 0 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] init_host_max_objects_retrieval = 0 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] instance_format = [instance: %(uuid)s] {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] iscsi_target_flags = {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] iscsi_write_cache = on {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] iser_helper = tgtadm {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] iser_ip_address = 192.168.122.95 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] iser_port = 3260 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] log_color = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] log_config_append = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] log_dir = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] log_file = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] log_options = True {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] log_rotate_interval = 1 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] log_rotate_interval_type = days {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] log_rotation_type = none {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] max_age = 0 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] max_logfile_count = 30 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] max_logfile_size_mb = 200 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86872]: INFO cinder.volume.manager [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Starting volume driver QuobyteDriver (1.2.1) Sep 05 11:31:07 devstack cinder-volume[86872]: DEBUG cinder.volume.drivers.remotefs [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86872) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] max_over_subscription_ratio = 20.0 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] message_reap_interval = 86400 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] message_ttl = 2592000 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] migration_create_volume_timeout_secs = 300 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] monkey_patch = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] monkey_patch_modules = [] {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] my_ip = 192.168.122.95 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] no_snapshot_gb_quota = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] num_iser_scan_tries = 3 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] num_shell_tries = 3 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] num_volume_device_scan_tries = 3 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] nvmeof_conn_info_version = 1 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] nvmet_ns_id = 10 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] nvmet_port_id = 1 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] osapi_max_limit = 1000 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] osapi_volume_ext_list = [] {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] osapi_volume_listen_port = 8776 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] osapi_volume_use_ssl = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] osapi_volume_workers = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] per_volume_size_limit = -1 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] periodic_fuzzy_delay = 60 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] periodic_interval = 60 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] public_endpoint = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] publish_errors = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] quota_backup_gigabytes = 1000 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] quota_backups = 10 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] quota_gigabytes = 1000 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] quota_groups = 10 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] quota_snapshots = 10 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] quota_volumes = 10 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] rate_limit_burst = 0 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] rate_limit_except_level = CRITICAL {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] rate_limit_interval = 0 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] reinit_driver_count = 3 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] replication_device = **** {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] report_discard_supported = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] report_interval = 120 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] reservation_clean_interval = 86400 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] reservation_expire = 86400 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] reserved_image_namespaces = [] {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] reserved_percentage = 0 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] rpc_response_timeout = 120 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] run_external_periodic_tasks = True {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] scst_target_driver = iscsi {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] scst_target_iqn_name = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] service_down_time = 720 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] shell_completion = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] snapshot_name_template = snapshot-%s {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] split_loggers = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] state_path = /opt/stack/data/cinder {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] storage_availability_zone = nova {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] storage_protocol = iSCSI {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] syslog_log_facility = LOG_USER {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] target_helper = lioadm {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] target_ip_address = 192.168.122.95 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] target_port = 3260 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] target_protocol = iscsi {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] target_secondary_ip_addresses = [] {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] trace_flags = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] transport_url = **** {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] until_refresh = 0 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] use_chap_auth = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] use_default_quota_class = True {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] use_journal = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] use_json = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] use_multipath_for_image_xfer = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] use_stderr = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] use_syslog = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] verify_glance_signatures = enabled {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] volume_api_class = cinder.volume.api.API {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] volume_backend_name = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] volume_clear = zero {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] volume_clear_ionice = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] volume_clear_size = 0 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] volume_copy_bps_limit = 0 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] volume_dd_blocksize = 1M {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] volume_name_template = volume-%s {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] volume_service_inithost_offload = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] volume_usage_audit_period = month {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] zoning_mode = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_concurrency.disable_process_locking = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.auth_section = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.auth_type = password {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.auth_version = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.cache = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.certfile = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.include_service_catalog = True {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.insecure = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.interface = public {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.keyfile = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.memcache_password = **** {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.memcache_username = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.region_name = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.service_type = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.95/identity {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.backend = dogpile.cache.null {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.backend_argument = **** {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.backend_expiration_time = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86872]: DEBUG cinder.volume.drivers.quobyte [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86872) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.config_prefix = cache.oslo {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.debug_cache_backend = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.enable_retry_client = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.enable_socket_keepalive = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.enabled = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.expiration_time = 600 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.hashclient_retry_attempts = 2 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.memcache_dead_retry = 300 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86872]: WARNING cinder.volume.drivers.quobyte [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 05 11:31:07 devstack cinder-volume[86872]: WARNING cinder.volume.drivers.quobyte [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 05 11:31:07 devstack cinder-volume[86872]: DEBUG oslo_concurrency.processutils [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Running cmd (subprocess): mount.quobyte {{(pid=86872) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.memcache_pool_maxsize = 10 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.memcache_sasl_enabled = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.password = **** {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.proxies = [] {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.redis_db = 0 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.redis_server = localhost:6379 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.retry_attempts = 2 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.retry_delay = 0.0 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.socket_keepalive_count = 1 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.socket_keepalive_idle = 1 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.socket_keepalive_interval = 1 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.socket_timeout = 1.0 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.tls_allowed_ciphers = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.tls_cafile = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.tls_certfile = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.tls_enabled = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.tls_keyfile = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cache.username = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] coordination.backend_url = **** {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] database.asyncio_connection = **** {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] database.asyncio_slave_connection = **** {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] database.backend = sqlalchemy {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] database.connection = **** {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] database.connection_debug = 0 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] database.connection_parameters = {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] database.connection_recycle_time = 3600 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] database.connection_trace = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] database.db_inc_retry_interval = True {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] database.db_max_retries = 20 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] database.db_max_retry_interval = 10 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] database.db_retry_interval = 1 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] database.max_overflow = 50 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] database.max_pool_size = 5 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] database.max_retries = 10 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] database.mysql_wsrep_sync_wait = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] database.pool_timeout = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] database.retry_interval = 10 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] database.slave_connection = **** {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] database.sqlite_synchronous = True {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] database.synchronous_reader = True {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] database.use_db_reconnect = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_tracing.insecure = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] profiler.connection_string = messaging:// {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] profiler.enabled = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] profiler.es_doc_type = notification {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] profiler.es_scroll_size = 10000 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] profiler.es_scroll_time = 2m {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] profiler.filter_error_trace = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] profiler.hmac_keys = **** {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] profiler.sentinel_service_name = mymaster {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] profiler.socket_timeout = 0.1 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] profiler.trace_requests = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] profiler.trace_sqlalchemy = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] profiler_jaeger.process_tags = {} {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] profiler_jaeger.service_name_prefix = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] profiler_otlp.service_name_prefix = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_policy.enforce_new_defaults = True {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_policy.policy_default_rule = default {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_policy.policy_file = policy.yaml {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] privsep_osbrick.group = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] privsep_osbrick.helper_command = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] privsep_osbrick.user = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cinder_sys_admin.group = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cinder_sys_admin.helper_command = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] cinder_sys_admin.user = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] service_user.auth_section = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] service_user.auth_type = password {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] service_user.cafile = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] service_user.certfile = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] service_user.collect_timing = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] service_user.insecure = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] service_user.keyfile = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] service_user.send_service_user_token = True {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] service_user.split_loggers = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] service_user.timeout = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] service_user.tls_ciphers = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] service_user.tls_min_version = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] glance.auth_section = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] glance.auth_type = password {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] glance.certfile = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] glance.collect_timing = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] glance.insecure = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] glance.keyfile = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] glance.region_name = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] glance.split_loggers = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] glance.timeout = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] glance.tls_ciphers = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] glance.tls_min_version = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.backend_availability_zone = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.chap_password = **** {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.chap_username = {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.disk_geometry = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.driver_client_cert = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.driver_client_cert_key = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.driver_data_namespace = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.driver_use_ssl = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.extra_capabilities = {} {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.filter_function = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.goodness_function = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.iscsi_target_flags = {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.iscsi_write_cache = on {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.iser_helper = tgtadm {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.iser_ip_address = 192.168.122.95 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.iser_port = 3260 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.nas_host = {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.nas_login = admin {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.nas_mount_options = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.nas_password = **** {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.nas_private_key = {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.nas_share_path = {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.num_shell_tries = 3 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.quobyte_volume_url = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.replication_device = **** {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.report_discard_supported = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.reserved_percentage = 0 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.target_helper = tgtadm {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.target_ip_address = 192.168.122.95 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.target_port = 3260 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.target_protocol = iscsi {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.trace_flags = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.unique_fqdn_network = True {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.use_chap_auth = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.volume_backend_name = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.volume_clear = zero {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.volume_clear_ionice = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.volume_clear_size = 0 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_reports.file_event_handler = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_reports.log_dir = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.backend_availability_zone = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.backend_host = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.chap_password = **** {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.chap_username = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.chiscsi_conf = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.disk_geometry = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.driver_client_cert = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.driver_data_namespace = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.driver_use_ssl = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.extra_capabilities = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.filter_function = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.goodness_function = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.iser_helper = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.iser_ip_address = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.iser_port = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.iser_target_prefix = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.nas_host = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.nas_login = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.nas_mount_options = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.nas_password = **** {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.nas_private_key = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.nas_share_path = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.nas_ssh_port = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.num_shell_tries = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.nvmet_port_id = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack quobyte-client[86873]: Reading configuration file: /etc/quobyte/client.cfg Sep 05 11:31:07 devstack quobyte-client[86873]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.replication_device = **** {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.report_discard_supported = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.reserved_percentage = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.scst_target_driver = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.storage_protocol = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86872]: DEBUG oslo_concurrency.processutils [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] CMD "mount.quobyte" returned: 1 in 0.197s {{(pid=86872) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:31:07 devstack cinder-volume[86872]: DEBUG oslo_concurrency.lockutils [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86872) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:31:07 devstack cinder-volume[86872]: DEBUG oslo_concurrency.lockutils [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86872) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:31:07 devstack cinder-volume[86872]: DEBUG cinder.volume.drivers.quobyte [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=86872) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:31:07 devstack cinder-volume[86872]: INFO cinder.volume.drivers.quobyte [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 ... Sep 05 11:31:07 devstack cinder-volume[86872]: DEBUG oslo_concurrency.processutils [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b -c /etc/quobyte/client-cinder.cfg {{(pid=86872) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.target_helper = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.target_ip_address = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.target_port = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.target_prefix = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.target_protocol = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.trace_flags = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.use_chap_auth = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.volume_clear = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.volume_clear_size = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] QuobyteHD.volumes_dir = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.ssl = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack sudo[86878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b -c /etc/quobyte/client-cinder.cfg Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_notifications.driver = [] {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack sudo[86878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_notifications.retry = -1 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] key_manager.fixed_key = **** {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] barbican.barbican_api_version = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] barbican.barbican_endpoint = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] barbican.barbican_endpoint_type = public {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] barbican.barbican_region_name = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] barbican.cafile = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] barbican.certfile = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] barbican.collect_timing = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] barbican.insecure = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] barbican.keyfile = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] barbican.number_of_retries = 60 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] barbican.retry_delay = 1 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] barbican.send_service_user_token = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] barbican.split_loggers = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] barbican.timeout = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] barbican.tls_ciphers = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] barbican.tls_min_version = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] barbican.verify_ssl = True {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] barbican.verify_ssl_path = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] barbican_service_user.auth_section = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] barbican_service_user.auth_type = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] barbican_service_user.cafile = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] barbican_service_user.certfile = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] barbican_service_user.collect_timing = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] barbican_service_user.insecure = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] barbican_service_user.keyfile = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] barbican_service_user.split_loggers = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] barbican_service_user.timeout = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] barbican_service_user.tls_ciphers = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] barbican_service_user.tls_min_version = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] vault.approle_role_id = **** {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] vault.approle_secret_id = **** {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] vault.auth_method = approle {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] vault.auth_path = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] vault.kv_mountpoint = secret {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] vault.kv_path = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] vault.kv_version = 2 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] vault.namespace = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] vault.root_token_id = **** {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] vault.ssl_ca_crt_file = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] vault.timeout = 60.0 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] vault.token_file = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] vault.token_role = None {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] vault.use_ssl = False {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:07 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] ******************************************************************************** {{(pid=86656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 05 11:31:07 devstack sudo[86878]: pam_unix(sudo:session): session closed for user root Sep 05 11:31:07 devstack cinder-volume[86872]: DEBUG oslo_concurrency.processutils [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.413s {{(pid=86872) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:31:07 devstack cinder-volume[86872]: INFO cinder.volume.drivers.quobyte [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 succeeded Sep 05 11:31:07 devstack cinder-volume[86872]: DEBUG cinder.volume.drivers.quobyte [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=86872) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:31:07 devstack cinder-volume[86872]: DEBUG oslo_concurrency.lockutils [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.426s {{(pid=86872) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:31:07 devstack cinder-volume[86872]: DEBUG oslo_concurrency.processutils [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=86872) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:31:07 devstack sudo[86947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:31:07 devstack sudo[86947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:31:08 devstack sudo[86947]: pam_unix(sudo:session): session closed for user root Sep 05 11:31:08 devstack cinder-volume[86872]: DEBUG oslo_concurrency.processutils [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.234s {{(pid=86872) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:31:08 devstack cinder-volume[86872]: INFO cinder.volume.driver [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Driver hasn't implemented _init_vendor_properties() Sep 05 11:31:08 devstack cinder-volume[86872]: DEBUG cinder.volume.driver [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6866188049316, 'free_capacity_gb': 1773.6866188049316, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86872) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 05 11:31:08 devstack cinder-volume[86872]: DEBUG oslo_db.sqlalchemy.engines [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86872) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 11:31:08 devstack cinder-volume[86872]: DEBUG dbcounter [-] [86872] Writer thread running {{(pid=86872) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 05 11:31:08 devstack cinder-volume[86872]: DEBUG cinder.db.api [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Building query based on filter {{(pid=86872) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 05 11:31:08 devstack cinder-volume[86872]: DEBUG cinder.image.image_utils [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86872) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 05 11:31:08 devstack cinder-volume[86872]: INFO cinder.keymgr.migration [None req-5e95bfbf-be73-4f46-9f65-3032c54f9df2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 05 11:31:08 devstack cinder-volume[86872]: DEBUG oslo_concurrency.lockutils [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86872) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:31:08 devstack cinder-volume[86872]: DEBUG oslo_concurrency.lockutils [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86872) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:31:08 devstack cinder-volume[86872]: DEBUG cinder.volume.drivers.quobyte [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=86872) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:31:08 devstack cinder-volume[86872]: DEBUG cinder.volume.drivers.quobyte [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=86872) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:31:08 devstack cinder-volume[86872]: DEBUG oslo_concurrency.lockutils [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86872) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:31:08 devstack cinder-volume[86872]: DEBUG oslo_concurrency.processutils [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=86872) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:31:08 devstack sudo[86951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:31:08 devstack sudo[86951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:31:08 devstack sudo[86951]: pam_unix(sudo:session): session closed for user root Sep 05 11:31:08 devstack cinder-volume[86872]: DEBUG oslo_concurrency.processutils [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.256s {{(pid=86872) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:31:08 devstack cinder-volume[86872]: DEBUG cinder.manager [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Notifying Schedulers of capabilities ... {{(pid=86872) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:31:08 devstack cinder-volume[86872]: INFO cinder.volume.manager [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Driver initialization completed successfully. Sep 05 11:31:08 devstack cinder-volume[86872]: INFO cinder.manager [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Initiating service 3 cleanup Sep 05 11:31:08 devstack cinder-volume[86872]: INFO cinder.manager [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Service 3 cleanup completed. Sep 05 11:31:08 devstack cinder-volume[86872]: DEBUG cinder.service [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Creating RPC server for service cinder-volume {{(pid=86872) start /opt/stack/cinder/cinder/service.py:231}} Sep 05 11:31:08 devstack cinder-volume[86872]: DEBUG cinder.service [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86872) start /opt/stack/cinder/cinder/service.py:237}} Sep 05 11:31:08 devstack cinder-volume[86872]: INFO cinder.volume.manager [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 05 11:31:08 devstack cinder-volume[86872]: DEBUG oslo_concurrency.lockutils [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86872) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:31:08 devstack cinder-volume[86872]: DEBUG oslo_concurrency.lockutils [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86872) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:31:08 devstack cinder-volume[86872]: DEBUG cinder.volume.drivers.quobyte [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=86872) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:31:08 devstack cinder-volume[86872]: DEBUG cinder.volume.drivers.quobyte [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=86872) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:31:08 devstack cinder-volume[86872]: DEBUG oslo_concurrency.lockutils [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86872) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:31:08 devstack cinder-volume[86872]: DEBUG oslo_concurrency.processutils [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=86872) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:31:08 devstack sudo[86954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:31:08 devstack sudo[86954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:31:08 devstack sudo[86954]: pam_unix(sudo:session): session closed for user root Sep 05 11:31:08 devstack cinder-volume[86872]: DEBUG oslo_concurrency.processutils [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.283s {{(pid=86872) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:31:08 devstack cinder-volume[86872]: INFO cinder.volume.manager [None req-1e7863c7-55be-435f-ab52-7f91c51fe08f None None] Driver post RPC initialization completed successfully. Sep 05 11:31:13 devstack cinder-volume[86872]: DEBUG oslo_concurrency.lockutils [None req-1cfd4060-05e6-42e5-beb2-3279a16f3376 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86872) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:31:13 devstack cinder-volume[86872]: DEBUG oslo_concurrency.lockutils [None req-1cfd4060-05e6-42e5-beb2-3279a16f3376 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86872) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:31:13 devstack cinder-volume[86872]: DEBUG cinder.volume.drivers.quobyte [None req-1cfd4060-05e6-42e5-beb2-3279a16f3376 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=86872) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:31:13 devstack cinder-volume[86872]: DEBUG cinder.volume.drivers.quobyte [None req-1cfd4060-05e6-42e5-beb2-3279a16f3376 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=86872) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:31:13 devstack cinder-volume[86872]: DEBUG oslo_concurrency.lockutils [None req-1cfd4060-05e6-42e5-beb2-3279a16f3376 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86872) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:31:13 devstack cinder-volume[86872]: DEBUG oslo_concurrency.processutils [None req-1cfd4060-05e6-42e5-beb2-3279a16f3376 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=86872) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:31:13 devstack sudo[87074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:31:13 devstack sudo[87074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:31:13 devstack sudo[87074]: pam_unix(sudo:session): session closed for user root Sep 05 11:31:13 devstack cinder-volume[86872]: DEBUG oslo_concurrency.processutils [None req-1cfd4060-05e6-42e5-beb2-3279a16f3376 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.224s {{(pid=86872) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:31:13 devstack cinder-volume[86872]: DEBUG cinder.manager [None req-1cfd4060-05e6-42e5-beb2-3279a16f3376 None None] Notifying Schedulers of capabilities ... {{(pid=86872) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:31:16 devstack cinder-volume[86656]: DEBUG dbcounter [-] [86656] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86656) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:31:17 devstack cinder-volume[86656]: INFO oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] Caught SIGTERM, stopping children Sep 05 11:31:17 devstack cinder-volume[86656]: DEBUG oslo_concurrency.lockutils [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] Acquiring lock "singleton_lock" {{(pid=86656) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 11:31:17 devstack cinder-volume[86656]: DEBUG oslo_concurrency.lockutils [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] Acquired lock "singleton_lock" {{(pid=86656) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 11:31:17 devstack cinder-volume[86656]: DEBUG oslo_concurrency.lockutils [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] Releasing lock "singleton_lock" {{(pid=86656) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 11:31:17 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] Stop services. {{(pid=86656) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 05 11:31:17 devstack cinder-volume[86656]: DEBUG oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] Killing children. {{(pid=86656) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 05 11:31:17 devstack cinder-volume[86656]: INFO oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] Waiting on 1 children to exit Sep 05 11:31:18 devstack cinder-volume[86872]: DEBUG dbcounter [-] [86872] Writing DB stats cinder:SELECT=4 {{(pid=86872) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:31:19 devstack cinder-volume[86872]: DEBUG dbcounter [-] [86872] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86872) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:31:21 devstack cinder-volume[86872]: DEBUG oslo_concurrency.lockutils [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] Acquiring lock "singleton_lock" {{(pid=86872) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 11:31:21 devstack cinder-volume[86872]: DEBUG oslo_concurrency.lockutils [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] Acquired lock "singleton_lock" {{(pid=86872) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 11:31:21 devstack cinder-volume[86872]: DEBUG oslo_concurrency.lockutils [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] Releasing lock "singleton_lock" {{(pid=86872) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 11:31:21 devstack cinder-volume[86872]: WARNING amqp [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 05 11:31:21 devstack cinder-volume[86872]: WARNING amqp [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 05 11:31:21 devstack cinder-volume[86656]: INFO oslo_service.backend._eventlet.service [None req-6cd21e3d-59b1-4372-bbd1-d18cbf10cec5 None None] Child 86872 exited with status 0 Sep 05 11:31:22 devstack cinder-volume[87225]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 05 11:31:22 devstack cinder-volume[87225]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 05 11:31:22 devstack cinder-volume[87225]: we strongly recommend against using it for new projects. Sep 05 11:31:22 devstack cinder-volume[87225]: If you are already using Eventlet, we recommend migrating to a different Sep 05 11:31:22 devstack cinder-volume[87225]: framework. For more detail see Sep 05 11:31:22 devstack cinder-volume[87225]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 05 11:31:22 devstack cinder-volume[87225]: import eventlet # noqa Sep 05 11:31:24 devstack cinder-volume[87225]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87225) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 11:31:24 devstack cinder-volume[87225]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87225) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 11:31:24 devstack cinder-volume[87225]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87225) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 11:31:25 devstack cinder-volume[87225]: INFO dbcounter [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] Registered counter for database cinder Sep 05 11:31:25 devstack cinder-volume[87225]: DEBUG oslo_db.sqlalchemy.engines [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87225) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 11:31:25 devstack cinder-volume[87225]: DEBUG dbcounter [-] [87225] Writer thread running {{(pid=87225) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 05 11:31:25 devstack cinder-volume[87225]: INFO cinder.rpc [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 05 11:31:25 devstack cinder-volume[87225]: INFO cinder.rpc [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 05 11:31:25 devstack cinder-volume[87225]: DEBUG oslo_db.sqlalchemy.engines [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87225) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 11:31:25 devstack cinder-volume[87225]: INFO cinder.volume.manager [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] Determined volume DB was empty at startup. Sep 05 11:31:25 devstack cinder-volume[87225]: DEBUG cinder.volume.manager [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87225) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 05 11:31:25 devstack cinder-volume[87225]: WARNING stevedore.named [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 05 11:31:25 devstack cinder-volume[87225]: WARNING castellan.key_manager [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 11:31:25 devstack cinder-volume[87225]: WARNING cinder.keymgr.conf_key_mgr [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 11:31:25 devstack cinder-volume[87225]: INFO cinder.volume.manager [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 05 11:31:25 devstack cinder-volume[87225]: DEBUG oslo_db.sqlalchemy.engines [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87225) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 11:31:25 devstack cinder-volume[87225]: INFO oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] Starting 1 workers Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] Started child 87517 {{(pid=87225) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] Full set of CONF: {{(pid=87225) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] ******************************************************************************** {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] Configuration options gathered from: {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] ================================================================================ {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 05 11:31:26 devstack cinder-volume[87517]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] allow_availability_zone_fallback = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] allow_compression_on_image_upload = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] allowed_direct_url_schemes = [] {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] api_rate_limit = True {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] auth_strategy = keystone {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_availability_zone = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_host = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_name = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_stats_polling_interval = 60 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backup_api_class = cinder.backup.api.API {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backup_name_template = backup-%s {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backup_use_same_host = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backup_use_temp_snapshot = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] chap_password = **** {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] chap_username = {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cinder_internal_tenant_project_id = 8fb26e18715d4d3d915e02f4a340ebb6 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cinder_internal_tenant_user_id = a7df2bd72b4d4d828c2130bb9952cc6f {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cluster = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] compression_format = gzip {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] compute_api_class = cinder.compute.nova.API {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] config_dir = [] {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] config_source = [] {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] control_exchange = openstack {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] debug = True {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] default_availability_zone = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] default_group_type = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] default_volume_type = QuobyteHD {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] disk_geometry = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] driver_client_cert = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] driver_client_cert_key = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] driver_data_namespace = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] driver_ssl_cert_path = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] driver_ssl_cert_verify = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] driver_use_ssl = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] enable_new_services = True {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] enable_unsupported_driver = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] enabled_backends = ['QuobyteHD'] {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] enforce_multipath_for_image_xfer = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] filter_function = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] glance_api_insecure = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] glance_api_servers = ['http://192.168.122.95/image'] {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] glance_api_ssl_compression = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] glance_ca_certificates_file = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] glance_catalog_info = image:glance:publicURL {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] glance_certfile = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] glance_keyfile = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] glance_num_retries = 3 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] glance_request_timeout = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] goodness_function = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] graceful_shutdown_timeout = 5 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] group_api_class = cinder.group.api.API {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] host = devstack {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] image_compress_on_upload = True {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] image_conversion_address_space_limit = 1 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] image_conversion_cpu_limit = 60 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 05 11:31:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87517) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] image_conversion_disable = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] image_upload_use_cinder_backend = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] image_upload_use_internal_tenant = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] image_volume_cache_enabled = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] image_volume_cache_max_count = 0 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] image_volume_cache_max_size_gb = 0 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] init_host_max_objects_retrieval = 0 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] instance_format = [instance: %(uuid)s] {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] iscsi_target_flags = {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] iscsi_write_cache = on {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] iser_helper = tgtadm {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] iser_ip_address = 192.168.122.95 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] iser_port = 3260 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] log_color = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] log_config_append = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] log_dir = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] log_file = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] log_options = True {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] log_rotate_interval = 1 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] log_rotate_interval_type = days {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] log_rotation_type = none {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] max_age = 0 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] max_logfile_count = 30 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] max_logfile_size_mb = 200 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] max_over_subscription_ratio = 20.0 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] message_reap_interval = 86400 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] message_ttl = 2592000 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] migration_create_volume_timeout_secs = 300 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] monkey_patch = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] monkey_patch_modules = [] {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] my_ip = 192.168.122.95 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] no_snapshot_gb_quota = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] num_iser_scan_tries = 3 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] num_shell_tries = 3 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] num_volume_device_scan_tries = 3 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] nvmeof_conn_info_version = 1 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] nvmet_ns_id = 10 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] nvmet_port_id = 1 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] osapi_max_limit = 1000 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] osapi_volume_ext_list = [] {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] osapi_volume_listen = 0.0.0.0 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] osapi_volume_listen_port = 8776 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] osapi_volume_use_ssl = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] osapi_volume_workers = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] per_volume_size_limit = -1 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] periodic_fuzzy_delay = 60 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] periodic_interval = 60 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] project_id_regex = [0-9a-f\-]+ {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] public_endpoint = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] publish_errors = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] quota_backup_gigabytes = 1000 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] quota_backups = 10 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] quota_gigabytes = 1000 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] quota_groups = 10 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] quota_snapshots = 10 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] quota_volumes = 10 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] rate_limit_burst = 0 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] rate_limit_except_level = CRITICAL {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] rate_limit_interval = 0 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] reinit_driver_count = 3 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] replication_device = **** {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] report_discard_supported = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] report_interval = 120 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] reservation_clean_interval = 86400 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] reservation_expire = 86400 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] reserved_image_namespaces = [] {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] reserved_percentage = 0 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] rpc_response_timeout = 120 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] run_external_periodic_tasks = True {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] scst_target_driver = iscsi {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] scst_target_iqn_name = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] service_down_time = 720 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] shell_completion = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] snapshot_name_template = snapshot-%s {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] split_loggers = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] state_path = /opt/stack/data/cinder {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] storage_availability_zone = nova {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] storage_protocol = iSCSI {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] syslog_log_facility = LOG_USER {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] target_helper = lioadm {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] target_ip_address = 192.168.122.95 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] target_port = 3260 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] target_protocol = iscsi {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] target_secondary_ip_addresses = [] {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] trace_flags = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] transfer_api_class = cinder.transfer.api.API {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] transport_url = **** {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] until_refresh = 0 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] use_chap_auth = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] use_default_quota_class = True {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] use_journal = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] use_json = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] use_multipath_for_image_xfer = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] use_stderr = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] use_syslog = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] verify_glance_signatures = enabled {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] volume_api_class = cinder.volume.api.API {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] volume_backend_name = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] volume_clear = zero {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] volume_clear_ionice = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87517) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] volume_clear_size = 0 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] volume_copy_bps_limit = 0 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.quobyte [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 05 11:31:26 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.quobyte [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] volume_dd_blocksize = 1M {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] volume_name_template = volume-%s {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] Running cmd (subprocess): mount.quobyte {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] volume_service_inithost_offload = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] volume_usage_audit_period = month {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] zoning_mode = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_concurrency.disable_process_locking = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.auth_section = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.auth_type = password {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.auth_version = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.cache = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.certfile = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.delay_auth_decision = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.http_connect_timeout = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.include_service_catalog = True {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.insecure = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.interface = public {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.keyfile = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.memcache_password = **** {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.memcache_username = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.region_name = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.service_token_roles_required = True {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.service_type = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.token_cache_time = 300 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.95/identity {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.backend = dogpile.cache.null {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.backend_argument = **** {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.backend_expiration_time = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.config_prefix = cache.oslo {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.debug_cache_backend = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.enable_retry_client = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.enable_socket_keepalive = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.enabled = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.expiration_time = 600 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.hashclient_retry_attempts = 2 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.memcache_dead_retry = 300 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.memcache_pool_maxsize = 10 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.memcache_sasl_enabled = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.password = **** {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.proxies = [] {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.redis_db = 0 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.redis_sentinel_service_name = mymaster {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.redis_server = localhost:6379 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.retry_attempts = 2 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.retry_delay = 0.0 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.socket_keepalive_count = 1 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.socket_keepalive_idle = 1 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.socket_keepalive_interval = 1 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.socket_timeout = 1.0 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.tls_allowed_ciphers = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.tls_cafile = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.tls_certfile = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.tls_enabled = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.tls_keyfile = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cache.username = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] coordination.backend_url = **** {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] database.asyncio_connection = **** {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] database.asyncio_slave_connection = **** {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] database.backend = sqlalchemy {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] database.connection = **** {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] database.connection_debug = 0 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] database.connection_parameters = {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] database.connection_recycle_time = 3600 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] database.connection_trace = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] database.db_inc_retry_interval = True {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] database.db_max_retries = 20 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack quobyte-client[87518]: Reading configuration file: /etc/quobyte/client.cfg Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] database.db_max_retry_interval = 10 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] database.db_retry_interval = 1 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] database.max_overflow = 50 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] database.max_pool_size = 5 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] database.max_retries = 10 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack quobyte-client[87518]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] database.mysql_wsrep_sync_wait = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] database.pool_timeout = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] database.retry_interval = 10 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] CMD "mount.quobyte" returned: 1 in 0.049s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] database.slave_connection = **** {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] database.sqlite_synchronous = True {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] database.synchronous_reader = True {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] database.use_db_reconnect = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_tracing.insecure = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] profiler.connection_string = messaging:// {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] profiler.enabled = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] profiler.es_doc_type = notification {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] profiler.es_scroll_size = 10000 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] profiler.es_scroll_time = 2m {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] profiler.filter_error_trace = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] profiler.hmac_keys = **** {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] profiler.sentinel_service_name = mymaster {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] profiler.socket_timeout = 0.1 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] profiler.trace_requests = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] profiler.trace_sqlalchemy = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] profiler_jaeger.process_tags = {} {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] profiler_jaeger.service_name_prefix = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] profiler_otlp.service_name_prefix = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_policy.enforce_new_defaults = True {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:31:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:31:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_policy.policy_default_rule = default {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_policy.policy_file = policy.yaml {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_policy.remote_timeout = 60.0 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] privsep_osbrick.group = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] privsep_osbrick.helper_command = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] privsep_osbrick.user = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cinder_sys_admin.group = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cinder_sys_admin.helper_command = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] cinder_sys_admin.user = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] service_user.auth_section = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] service_user.auth_type = password {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] service_user.cafile = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] service_user.certfile = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] service_user.collect_timing = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack sudo[87519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] service_user.insecure = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] service_user.keyfile = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] service_user.send_service_user_token = True {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] service_user.split_loggers = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] service_user.timeout = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] service_user.tls_ciphers = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] service_user.tls_min_version = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack sudo[87519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] glance.auth_section = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] glance.auth_type = password {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] glance.certfile = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] glance.collect_timing = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] glance.insecure = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] glance.keyfile = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] glance.region_name = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] glance.split_loggers = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] glance.timeout = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] glance.tls_ciphers = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] glance.tls_min_version = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.backend_availability_zone = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.chap_password = **** {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.chap_username = {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.disk_geometry = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.driver_client_cert = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.driver_client_cert_key = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.driver_data_namespace = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.driver_use_ssl = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.enable_unsupported_driver = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.extra_capabilities = {} {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.filter_function = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.goodness_function = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.iscsi_target_flags = {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.iscsi_write_cache = on {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.iser_helper = tgtadm {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.iser_ip_address = 192.168.122.95 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.iser_port = 3260 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.nas_host = {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.nas_login = admin {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.nas_mount_options = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.nas_password = **** {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.nas_private_key = {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.nas_share_path = {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.nas_ssh_port = 22 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.num_shell_tries = 3 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.nvmet_port_id = 1 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.quobyte_client_cfg = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.quobyte_volume_url = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.replication_device = **** {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.report_discard_supported = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.reserved_percentage = 0 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.scst_target_driver = iscsi {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.scst_target_iqn_name = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.storage_protocol = iSCSI {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.target_helper = tgtadm {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.target_ip_address = 192.168.122.95 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.target_port = 3260 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.target_protocol = iscsi {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.trace_flags = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.unique_fqdn_network = True {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.use_chap_auth = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.volume_backend_name = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.volume_clear = zero {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.volume_clear_ionice = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.volume_clear_size = 0 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_reports.file_event_handler = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_reports.log_dir = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.backend_availability_zone = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.backend_host = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.chap_password = **** {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.chap_username = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.chiscsi_conf = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.disk_geometry = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.driver_client_cert = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.driver_client_cert_key = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.driver_data_namespace = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.driver_use_ssl = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.extra_capabilities = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.filter_function = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.goodness_function = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.iscsi_target_flags = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.iscsi_write_cache = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.iser_helper = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.iser_ip_address = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.iser_port = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.iser_target_prefix = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.nas_host = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.nas_login = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.nas_mount_options = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.nas_password = **** {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.nas_private_key = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.nas_share_path = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.nas_ssh_port = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.num_shell_tries = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.nvmet_ns_id = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.nvmet_port_id = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.replication_device = **** {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.report_discard_supported = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.reserved_percentage = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.scst_target_driver = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.storage_protocol = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.target_helper = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.target_ip_address = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.target_port = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.target_prefix = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.target_protocol = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.trace_flags = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.unique_fqdn_network = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.use_chap_auth = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.volume_clear = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.volume_clear_ionice = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.volume_clear_size = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] QuobyteHD.volumes_dir = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.ssl = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.ssl_version = {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_notifications.driver = [] {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_notifications.retry = -1 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] oslo_messaging_notifications.transport_url = **** {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] key_manager.fixed_key = **** {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] barbican.barbican_api_version = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] barbican.barbican_endpoint = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] barbican.barbican_endpoint_type = public {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] barbican.barbican_region_name = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] barbican.cafile = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] barbican.certfile = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] barbican.collect_timing = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] barbican.insecure = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] barbican.keyfile = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] barbican.number_of_retries = 60 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] barbican.retry_delay = 1 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] barbican.send_service_user_token = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] barbican.split_loggers = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] barbican.timeout = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] barbican.tls_ciphers = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] barbican.tls_min_version = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] barbican.verify_ssl = True {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] barbican.verify_ssl_path = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] barbican_service_user.auth_section = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] barbican_service_user.auth_type = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] barbican_service_user.cafile = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] barbican_service_user.certfile = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] barbican_service_user.collect_timing = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] barbican_service_user.insecure = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] barbican_service_user.keyfile = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] barbican_service_user.split_loggers = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] barbican_service_user.timeout = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] barbican_service_user.tls_ciphers = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] barbican_service_user.tls_min_version = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] vault.approle_role_id = **** {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] vault.approle_secret_id = **** {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] vault.auth_method = approle {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] vault.auth_path = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] vault.kv_mountpoint = secret {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] vault.kv_path = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] vault.kv_version = 2 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] vault.namespace = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] vault.root_token_id = **** {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] vault.ssl_ca_crt_file = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] vault.timeout = 60.0 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] vault.token_file = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] vault.token_role = None {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] vault.use_ssl = False {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 11:31:26 devstack cinder-volume[87225]: DEBUG oslo_service.backend._eventlet.service [None req-d71e9ce9-6ccc-476d-a1f2-a8ae25acf0ba None None] ******************************************************************************** {{(pid=87225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 05 11:31:26 devstack sudo[87519]: pam_unix(sudo:session): session closed for user root Sep 05 11:31:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.275s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:31:26 devstack cinder-volume[87517]: INFO cinder.volume.driver [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] Driver hasn't implemented _init_vendor_properties() Sep 05 11:31:26 devstack cinder-volume[87517]: DEBUG cinder.volume.driver [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6866188049316, 'free_capacity_gb': 1773.6866188049316, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87517) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 05 11:31:26 devstack cinder-volume[87517]: DEBUG oslo_db.sqlalchemy.engines [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87517) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 11:31:26 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writer thread running {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 05 11:31:26 devstack cinder-volume[87517]: DEBUG cinder.db.api [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] Building query based on filter {{(pid=87517) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 05 11:31:26 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87517) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 05 11:31:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:31:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:31:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:31:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:31:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:31:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:31:26 devstack cinder-volume[87517]: INFO cinder.keymgr.migration [None req-ebf32e83-48a5-496d-89ef-39df32d6529c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 05 11:31:26 devstack sudo[87533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:31:26 devstack sudo[87533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:31:26 devstack sudo[87533]: pam_unix(sudo:session): session closed for user root Sep 05 11:31:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.256s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:31:26 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:31:26 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] Driver initialization completed successfully. Sep 05 11:31:26 devstack cinder-volume[87517]: INFO cinder.manager [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] Initiating service 3 cleanup Sep 05 11:31:26 devstack cinder-volume[87517]: INFO cinder.manager [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] Service 3 cleanup completed. Sep 05 11:31:26 devstack cinder-volume[87517]: DEBUG cinder.service [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] Creating RPC server for service cinder-volume {{(pid=87517) start /opt/stack/cinder/cinder/service.py:231}} Sep 05 11:31:26 devstack cinder-volume[87517]: DEBUG cinder.service [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87517) start /opt/stack/cinder/cinder/service.py:237}} Sep 05 11:31:26 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 05 11:31:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:31:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:31:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:31:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:31:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:31:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:31:26 devstack sudo[87544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:31:26 devstack sudo[87544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:31:27 devstack sudo[87544]: pam_unix(sudo:session): session closed for user root Sep 05 11:31:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.254s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:31:27 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-aa78c5dd-27c7-403c-bef1-4d6531893ff1 None None] Driver post RPC initialization completed successfully. Sep 05 11:31:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:31:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread count: 6 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 11:31:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread info: [<_MainThread(MainThread, started 131707869511808)>, , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 11:31:35 devstack cinder-volume[87225]: DEBUG dbcounter [-] [87225] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87225) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:31:36 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:31:37 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=2 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:32:25 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:32:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] Flow 'volume_create_manager' (7d9bb026-707d-4c1d-9810-04cec40e4048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:32:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a65e29b-f004-4def-bfc6-6aa43284eb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:32:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a65e29b-f004-4def-bfc6-6aa43284eb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-783715819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52590547-84b7-4636-b784-488b5e9c99ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92de12d33e8e45158ad2b719b50e3fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:32:26Z,use_quota=True,user_id='aa59b7617e304a12850bf4f7c2fda599',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:32:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b13e826-61fb-47d3-be36-8a2b9f27d79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:32:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b13e826-61fb-47d3-be36-8a2b9f27d79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:32:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73c7247b-5551-49c1-a6dc-37917d939401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:32:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73c7247b-5551-49c1-a6dc-37917d939401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52590547-84b7-4636-b784-488b5e9c99ac', 'volume_name': 'volume-52590547-84b7-4636-b784-488b5e9c99ac', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:32:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c7b63e-4741-4c6e-a056-0ebb41f25170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:32:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c7b63e-4741-4c6e-a056-0ebb41f25170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:32:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e310c17-be06-4d65-b9da-13649fe70b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:32:26 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] Volume 52590547-84b7-4636-b784-488b5e9c99ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52590547-84b7-4636-b784-488b5e9c99ac', 'volume_size': 1} Sep 05 11:32:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:32:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:32:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-783715819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52590547-84b7-4636-b784-488b5e9c99ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92de12d33e8e45158ad2b719b50e3fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:32:26Z,use_quota=True,user_id='aa59b7617e304a12850bf4f7c2fda599',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:32:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] Creating volume 52590547-84b7-4636-b784-488b5e9c99ac {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:32:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:32:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:32:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:32:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:32:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:32:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:32:26 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:32:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-52590547-84b7-4636-b784-488b5e9c99ac 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:32:26 devstack sudo[88332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-52590547-84b7-4636-b784-488b5e9c99ac 1073741824 Sep 05 11:32:26 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:32:26 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:32:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] Flow 'volume_create_manager' (34147099-8413-4f6c-a4ed-2a3ed1931235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:32:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87be98ae-f19c-4048-bbd2-bab98f190a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:32:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87be98ae-f19c-4048-bbd2-bab98f190a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-100953047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ba94e9e-37c0-4d31-8de3-1ef79a135552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='397fe553be784ac99fc2f36d7f2ff305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:32:26Z,use_quota=True,user_id='bed334d2bb7e457aab673efe2369db8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:32:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02758ea8-07a0-4fd0-b0ae-d23f043f9d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:32:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02758ea8-07a0-4fd0-b0ae-d23f043f9d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:32:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be4baba0-a821-41fe-8faf-55a0f823011f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:32:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be4baba0-a821-41fe-8faf-55a0f823011f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ba94e9e-37c0-4d31-8de3-1ef79a135552', 'volume_name': 'volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:32:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (296be80a-1007-4f89-ad28-a22eb6bf811f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:32:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (296be80a-1007-4f89-ad28-a22eb6bf811f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:32:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d019282-4b84-4080-ad4b-781de6887da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:32:26 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] Volume 7ba94e9e-37c0-4d31-8de3-1ef79a135552: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552', 'volume_size': 1} Sep 05 11:32:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:32:27 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root Sep 05 11:32:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-52590547-84b7-4636-b784-488b5e9c99ac 1073741824" returned: 0 in 1.733s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:32:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-52590547-84b7-4636-b784-488b5e9c99ac {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:32:28 devstack sudo[88649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-52590547-84b7-4636-b784-488b5e9c99ac Sep 05 11:32:28 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:32:28 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root Sep 05 11:32:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-52590547-84b7-4636-b784-488b5e9c99ac" returned: 0 in 0.817s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:32:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] <== create_volume: return (2714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:32:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.721s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:32:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.140s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:32:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-100953047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ba94e9e-37c0-4d31-8de3-1ef79a135552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='397fe553be784ac99fc2f36d7f2ff305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:32:26Z,use_quota=True,user_id='bed334d2bb7e457aab673efe2369db8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:32:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] Creating volume 7ba94e9e-37c0-4d31-8de3-1ef79a135552 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:32:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:32:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:32:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:32:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:32:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:32:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:32:28 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:32:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:32:29 devstack sudo[88652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552 1073741824 Sep 05 11:32:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e310c17-be06-4d65-b9da-13649fe70b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52590547-84b7-4636-b784-488b5e9c99ac', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:32:29 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:32:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c988c6-f425-4c5c-ab2d-ceda9adb3cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:32:29 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] Volume volume-52590547-84b7-4636-b784-488b5e9c99ac (52590547-84b7-4636-b784-488b5e9c99ac): created successfully Sep 05 11:32:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c988c6-f425-4c5c-ab2d-ceda9adb3cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:32:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] Flow 'volume_create_manager' (7d9bb026-707d-4c1d-9810-04cec40e4048) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:32:29 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-994de509-a169-4d9d-a09c-96da461e5bf7 tempest-DeleteServersTestJSON-664891014 None] Created volume successfully. Sep 05 11:32:29 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:32:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] Flow 'volume_create_manager' (fd8c9002-c252-4f4c-991f-bb281c2aace5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:32:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea07455c-5f49-4325-a659-4ca6d2c7f816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:32:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea07455c-5f49-4325-a659-4ca6d2c7f816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1333819138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ccb5aba-884e-489b-84f8-b5bc2a3b2dac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51dd9ab4311445fcb3d4ff5f6ce61c85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:32:29Z,use_quota=True,user_id='1850709d3b074ced870ad0dbfb3b86df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:32:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e5d84f-ee5f-405a-bb64-c76fe8153c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:32:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e5d84f-ee5f-405a-bb64-c76fe8153c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:32:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28a837a-7c9c-4f9c-b38b-bba33a8809ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:32:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28a837a-7c9c-4f9c-b38b-bba33a8809ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ccb5aba-884e-489b-84f8-b5bc2a3b2dac', 'volume_name': 'volume-9ccb5aba-884e-489b-84f8-b5bc2a3b2dac', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:32:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43bd6599-3039-4855-8ae9-75a954c0b6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:32:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43bd6599-3039-4855-8ae9-75a954c0b6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:32:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb07ca17-d596-47dc-9112-88393320cabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:32:29 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] Volume 9ccb5aba-884e-489b-84f8-b5bc2a3b2dac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ccb5aba-884e-489b-84f8-b5bc2a3b2dac', 'volume_size': 1} Sep 05 11:32:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:32:30 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root Sep 05 11:32:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552 1073741824" returned: 0 in 1.657s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:32:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:32:30 devstack sudo[88665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552 Sep 05 11:32:30 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:32:31 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root Sep 05 11:32:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552" returned: 0 in 0.549s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:32:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] <== create_volume: return (2324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:32:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.335s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:32:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.390s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:32:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1333819138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ccb5aba-884e-489b-84f8-b5bc2a3b2dac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51dd9ab4311445fcb3d4ff5f6ce61c85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:32:29Z,use_quota=True,user_id='1850709d3b074ced870ad0dbfb3b86df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:32:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] Creating volume 9ccb5aba-884e-489b-84f8-b5bc2a3b2dac {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:32:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:32:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:32:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:32:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:32:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:32:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:32:31 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:32:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9ccb5aba-884e-489b-84f8-b5bc2a3b2dac 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:32:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d019282-4b84-4080-ad4b-781de6887da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:32:31 devstack sudo[88669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9ccb5aba-884e-489b-84f8-b5bc2a3b2dac 1073741824 Sep 05 11:32:31 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:32:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (576de9b0-0bae-40d5-981f-68a260186bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:32:31 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] Volume volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552 (7ba94e9e-37c0-4d31-8de3-1ef79a135552): created successfully Sep 05 11:32:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (576de9b0-0bae-40d5-981f-68a260186bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:32:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] Flow 'volume_create_manager' (34147099-8413-4f6c-a4ed-2a3ed1931235) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:32:31 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-4ab876c0-8e5e-4c5b-a800-36916e08b55c req-b9d3cfb5-34a4-49c0-9ad4-b06e9b62d2ee tempest-VolumesSnapshotsTestJSON-1939393310 None] Created volume successfully. Sep 05 11:32:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:32:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:32:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:32:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:32:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:32:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:32:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:32:32 devstack sudo[88676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:32:32 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:32:32 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root Sep 05 11:32:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9ccb5aba-884e-489b-84f8-b5bc2a3b2dac 1073741824" returned: 0 in 1.065s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:32:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9ccb5aba-884e-489b-84f8-b5bc2a3b2dac {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:32:32 devstack sudo[88679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9ccb5aba-884e-489b-84f8-b5bc2a3b2dac Sep 05 11:32:32 devstack sudo[88679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:32:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-ba1f1c26-f53c-4059-97ba-2747b288019c req-6899d3c6-d600-46b1-812c-1cf87e58acee tempest-VolumesSnapshotsTestJSON-1939393310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:32:33 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root Sep 05 11:32:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.962s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:32:33 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:32:33 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:32:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread count: 6 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 11:32:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread info: [<_MainThread(MainThread, started 131707869511808)>, , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 11:32:33 devstack sudo[88679]: pam_unix(sudo:session): session closed for user root Sep 05 11:32:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9ccb5aba-884e-489b-84f8-b5bc2a3b2dac" returned: 0 in 0.885s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:32:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] <== create_volume: return (2048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:32:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.059s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:32:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-ba1f1c26-f53c-4059-97ba-2747b288019c req-6899d3c6-d600-46b1-812c-1cf87e58acee tempest-VolumesSnapshotsTestJSON-1939393310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.221s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:32:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb07ca17-d596-47dc-9112-88393320cabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ccb5aba-884e-489b-84f8-b5bc2a3b2dac', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:32:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d61e885f-6f18-4a34-837a-b1897dce4507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:32:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [req-ba1f1c26-f53c-4059-97ba-2747b288019c req-6899d3c6-d600-46b1-812c-1cf87e58acee tempest-VolumesSnapshotsTestJSON-1939393310 None] Creating offline snapshot ef38dfd2-fa22-4cf0-a7ea-235e866cd1bb of volume 7ba94e9e-37c0-4d31-8de3-1ef79a135552 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:32:33 devstack cinder-volume[87517]: INFO oslo.privsep.daemon [req-ba1f1c26-f53c-4059-97ba-2747b288019c req-6899d3c6-d600-46b1-812c-1cf87e58acee tempest-VolumesSnapshotsTestJSON-1939393310 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpksfocnuo/privsep.sock'] Sep 05 11:32:33 devstack sudo[88750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpksfocnuo/privsep.sock Sep 05 11:32:33 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:32:33 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] Volume volume-9ccb5aba-884e-489b-84f8-b5bc2a3b2dac (9ccb5aba-884e-489b-84f8-b5bc2a3b2dac): created successfully Sep 05 11:32:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d61e885f-6f18-4a34-837a-b1897dce4507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:32:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] Flow 'volume_create_manager' (fd8c9002-c252-4f4c-991f-bb281c2aace5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:32:33 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-23853384-9539-4980-8c16-eaeb1b8230e3 tempest-ServerRescueNegativeTestJSON-693767323 None] Created volume successfully. Sep 05 11:32:35 devstack cinder-volume[87517]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 05 11:32:35 devstack cinder-volume[87517]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 05 11:32:35 devstack cinder-volume[87517]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 05 11:32:35 devstack cinder-volume[87517]: WARNING oslo.privsep.daemon [-] privsep log: Sep 05 11:32:35 devstack cinder-volume[87517]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 05 11:32:35 devstack cinder-volume[87517]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 05 11:32:35 devstack cinder-volume[87517]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 05 11:32:35 devstack cinder-volume[87517]: WARNING oslo.privsep.daemon [-] privsep log: Sep 05 11:32:35 devstack cinder-volume[87517]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 05 11:32:35 devstack cinder-volume[87517]: WARNING py.warnings [req-f3488dd2-896b-4f00-bcc6-f642b862af29 req-5d6e3c44-253f-454d-bcf4-ea2160f8c904 tempest-DeleteServersTestJSON-664891014 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 05 11:32:35 devstack cinder-volume[87517]: .first() Sep 05 11:32:35 devstack cinder-volume[87517]: Sep 05 11:32:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-f3488dd2-896b-4f00-bcc6-f642b862af29 req-5d6e3c44-253f-454d-bcf4-ea2160f8c904 tempest-DeleteServersTestJSON-664891014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:32:35 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root Sep 05 11:32:35 devstack cinder-volume[87517]: INFO oslo.privsep.daemon [req-ba1f1c26-f53c-4059-97ba-2747b288019c req-6899d3c6-d600-46b1-812c-1cf87e58acee tempest-VolumesSnapshotsTestJSON-1939393310 None] Spawned new privsep daemon via rootwrap Sep 05 11:32:35 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [req-ba1f1c26-f53c-4059-97ba-2747b288019c req-6899d3c6-d600-46b1-812c-1cf87e58acee tempest-VolumesSnapshotsTestJSON-1939393310 None] Accepted privsep connection to /tmp/tmpksfocnuo/privsep.sock {{(pid=87517) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 05 11:32:35 devstack cinder-volume[87517]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 05 11:32:35 devstack cinder-volume[87517]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 05 11:32:35 devstack cinder-volume[87517]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 05 11:32:35 devstack cinder-volume[87517]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88782 Sep 05 11:32:35 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3f687b-8045-4ed5-a108-0e6d37547436]: (2,) {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:32:36 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90e9eaa-f5e2-4f09-bddf-85d001397891]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:32:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-ba1f1c26-f53c-4059-97ba-2747b288019c req-6899d3c6-d600-46b1-812c-1cf87e58acee tempest-VolumesSnapshotsTestJSON-1939393310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:32:36 devstack sudo[88786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552 Sep 05 11:32:36 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:32:36 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root Sep 05 11:32:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-ba1f1c26-f53c-4059-97ba-2747b288019c req-6899d3c6-d600-46b1-812c-1cf87e58acee tempest-VolumesSnapshotsTestJSON-1939393310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552" returned: 0 in 0.551s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:32:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-ba1f1c26-f53c-4059-97ba-2747b288019c req-6899d3c6-d600-46b1-812c-1cf87e58acee tempest-VolumesSnapshotsTestJSON-1939393310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552.ef38dfd2-fa22-4cf0-a7ea-235e866cd1bb 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:32:36 devstack sudo[88792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552.ef38dfd2-fa22-4cf0-a7ea-235e866cd1bb 1G Sep 05 11:32:36 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:32:37 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root Sep 05 11:32:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-ba1f1c26-f53c-4059-97ba-2747b288019c req-6899d3c6-d600-46b1-812c-1cf87e58acee tempest-VolumesSnapshotsTestJSON-1939393310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552.ef38dfd2-fa22-4cf0-a7ea-235e866cd1bb 1G" returned: 0 in 0.709s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:32:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-ba1f1c26-f53c-4059-97ba-2747b288019c req-6899d3c6-d600-46b1-812c-1cf87e58acee tempest-VolumesSnapshotsTestJSON-1939393310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552.ef38dfd2-fa22-4cf0-a7ea-235e866cd1bb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:32:37 devstack sudo[88813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552.ef38dfd2-fa22-4cf0-a7ea-235e866cd1bb Sep 05 11:32:37 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:32:37 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root Sep 05 11:32:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-ba1f1c26-f53c-4059-97ba-2747b288019c req-6899d3c6-d600-46b1-812c-1cf87e58acee tempest-VolumesSnapshotsTestJSON-1939393310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552.ef38dfd2-fa22-4cf0-a7ea-235e866cd1bb" returned: 0 in 0.381s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:32:37 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [req-ba1f1c26-f53c-4059-97ba-2747b288019c req-6899d3c6-d600-46b1-812c-1cf87e58acee tempest-VolumesSnapshotsTestJSON-1939393310 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552.ef38dfd2-fa22-4cf0-a7ea-235e866cd1bb is being set with open permissions: ugo+rw Sep 05 11:32:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-ba1f1c26-f53c-4059-97ba-2747b288019c req-6899d3c6-d600-46b1-812c-1cf87e58acee tempest-VolumesSnapshotsTestJSON-1939393310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552.ef38dfd2-fa22-4cf0-a7ea-235e866cd1bb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:32:37 devstack sudo[88840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552.ef38dfd2-fa22-4cf0-a7ea-235e866cd1bb Sep 05 11:32:37 devstack sudo[88840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:32:37 devstack sudo[88840]: pam_unix(sudo:session): session closed for user root Sep 05 11:32:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-ba1f1c26-f53c-4059-97ba-2747b288019c req-6899d3c6-d600-46b1-812c-1cf87e58acee tempest-VolumesSnapshotsTestJSON-1939393310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552.ef38dfd2-fa22-4cf0-a7ea-235e866cd1bb" returned: 0 in 0.319s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:32:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-ba1f1c26-f53c-4059-97ba-2747b288019c req-6899d3c6-d600-46b1-812c-1cf87e58acee tempest-VolumesSnapshotsTestJSON-1939393310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:32:38 devstack sudo[88845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552.info Sep 05 11:32:38 devstack sudo[88845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:32:38 devstack sudo[88845]: pam_unix(sudo:session): session closed for user root Sep 05 11:32:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-ba1f1c26-f53c-4059-97ba-2747b288019c req-6899d3c6-d600-46b1-812c-1cf87e58acee tempest-VolumesSnapshotsTestJSON-1939393310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552.info" returned: 0 in 0.487s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:32:38 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [req-ba1f1c26-f53c-4059-97ba-2747b288019c req-6899d3c6-d600-46b1-812c-1cf87e58acee tempest-VolumesSnapshotsTestJSON-1939393310 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552.info is being set with open permissions: ugo+rw Sep 05 11:32:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-ba1f1c26-f53c-4059-97ba-2747b288019c req-6899d3c6-d600-46b1-812c-1cf87e58acee tempest-VolumesSnapshotsTestJSON-1939393310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:32:38 devstack sudo[88848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552.info Sep 05 11:32:38 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:32:38 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root Sep 05 11:32:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-ba1f1c26-f53c-4059-97ba-2747b288019c req-6899d3c6-d600-46b1-812c-1cf87e58acee tempest-VolumesSnapshotsTestJSON-1939393310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552.info" returned: 0 in 0.348s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:32:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-ba1f1c26-f53c-4059-97ba-2747b288019c req-6899d3c6-d600-46b1-812c-1cf87e58acee tempest-VolumesSnapshotsTestJSON-1939393310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.536s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:32:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-f3488dd2-896b-4f00-bcc6-f642b862af29 req-5d6e3c44-253f-454d-bcf4-ea2160f8c904 tempest-DeleteServersTestJSON-664891014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.139s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:32:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-f3488dd2-896b-4f00-bcc6-f642b862af29 req-5d6e3c44-253f-454d-bcf4-ea2160f8c904 tempest-DeleteServersTestJSON-664891014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.096s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:32:39 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-ba1f1c26-f53c-4059-97ba-2747b288019c req-6899d3c6-d600-46b1-812c-1cf87e58acee tempest-VolumesSnapshotsTestJSON-1939393310 None] Create snapshot completed successfully Sep 05 11:32:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-f3488dd2-896b-4f00-bcc6-f642b862af29 req-5d6e3c44-253f-454d-bcf4-ea2160f8c904 tempest-DeleteServersTestJSON-664891014 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32', 'name': 'volume-52590547-84b7-4636-b784-488b5e9c99ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c3fd2e5b-7c03-4607-b719-a1d8fc42d833', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 11:32:39 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-f3488dd2-896b-4f00-bcc6-f642b862af29 req-5d6e3c44-253f-454d-bcf4-ea2160f8c904 tempest-DeleteServersTestJSON-664891014 None] attachment_update completed successfully. Sep 05 11:32:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-e4701010-17a2-47a4-910a-80529f09b1ba req-1815543d-dc2b-4144-9c5a-6732786d820a tempest-VolumesSnapshotsTestJSON-1939393310 None] Acquiring lock "cinder-ef38dfd2-fa22-4cf0-a7ea-235e866cd1bb-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:32:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-e4701010-17a2-47a4-910a-80529f09b1ba req-1815543d-dc2b-4144-9c5a-6732786d820a tempest-VolumesSnapshotsTestJSON-1939393310 None] Lock "cinder-ef38dfd2-fa22-4cf0-a7ea-235e866cd1bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.066s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:32:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-e4701010-17a2-47a4-910a-80529f09b1ba req-1815543d-dc2b-4144-9c5a-6732786d820a tempest-VolumesSnapshotsTestJSON-1939393310 None] Acquiring lock "cinder-quobyte-7ba94e9e-37c0-4d31-8de3-1ef79a135552" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:32:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-e4701010-17a2-47a4-910a-80529f09b1ba req-1815543d-dc2b-4144-9c5a-6732786d820a tempest-VolumesSnapshotsTestJSON-1939393310 None] Lock "cinder-quobyte-7ba94e9e-37c0-4d31-8de3-1ef79a135552" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:32:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-e4701010-17a2-47a4-910a-80529f09b1ba req-1815543d-dc2b-4144-9c5a-6732786d820a tempest-VolumesSnapshotsTestJSON-1939393310 None] Acquiring lock "cinder-quobyte-ef38dfd2-fa22-4cf0-a7ea-235e866cd1bb" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:32:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-e4701010-17a2-47a4-910a-80529f09b1ba req-1815543d-dc2b-4144-9c5a-6732786d820a tempest-VolumesSnapshotsTestJSON-1939393310 None] Lock "cinder-quobyte-ef38dfd2-fa22-4cf0-a7ea-235e866cd1bb" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:32:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [req-e4701010-17a2-47a4-910a-80529f09b1ba req-1815543d-dc2b-4144-9c5a-6732786d820a tempest-VolumesSnapshotsTestJSON-1939393310 None] Deleting offline snapshot ef38dfd2-fa22-4cf0-a7ea-235e866cd1bb of volume 7ba94e9e-37c0-4d31-8de3-1ef79a135552 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:32:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [req-e4701010-17a2-47a4-910a-80529f09b1ba req-1815543d-dc2b-4144-9c5a-6732786d820a tempest-VolumesSnapshotsTestJSON-1939393310 None] snapshot_file for this snap is: volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552.ef38dfd2-fa22-4cf0-a7ea-235e866cd1bb {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:32:39 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c26f3f3-8652-4a38-a7b6-b2585e397275]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:32:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-e4701010-17a2-47a4-910a-80529f09b1ba req-1815543d-dc2b-4144-9c5a-6732786d820a tempest-VolumesSnapshotsTestJSON-1939393310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552.ef38dfd2-fa22-4cf0-a7ea-235e866cd1bb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:32:40 devstack sudo[88875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552.ef38dfd2-fa22-4cf0-a7ea-235e866cd1bb Sep 05 11:32:40 devstack sudo[88875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:32:41 devstack sudo[88875]: pam_unix(sudo:session): session closed for user root Sep 05 11:32:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-e4701010-17a2-47a4-910a-80529f09b1ba req-1815543d-dc2b-4144-9c5a-6732786d820a tempest-VolumesSnapshotsTestJSON-1939393310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552.ef38dfd2-fa22-4cf0-a7ea-235e866cd1bb" returned: 0 in 1.271s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:32:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [req-e4701010-17a2-47a4-910a-80529f09b1ba req-1815543d-dc2b-4144-9c5a-6732786d820a tempest-VolumesSnapshotsTestJSON-1939393310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:32:41 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a70af85-0ab8-4c6e-9214-36eece53b40c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:32:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-e4701010-17a2-47a4-910a-80529f09b1ba req-1815543d-dc2b-4144-9c5a-6732786d820a tempest-VolumesSnapshotsTestJSON-1939393310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:32:41 devstack sudo[89242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552 Sep 05 11:32:41 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:32:41 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root Sep 05 11:32:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-e4701010-17a2-47a4-910a-80529f09b1ba req-1815543d-dc2b-4144-9c5a-6732786d820a tempest-VolumesSnapshotsTestJSON-1939393310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552" returned: 0 in 0.681s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:32:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-e4701010-17a2-47a4-910a-80529f09b1ba req-1815543d-dc2b-4144-9c5a-6732786d820a tempest-VolumesSnapshotsTestJSON-1939393310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552.ef38dfd2-fa22-4cf0-a7ea-235e866cd1bb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:32:41 devstack sudo[89249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552.ef38dfd2-fa22-4cf0-a7ea-235e866cd1bb Sep 05 11:32:41 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:32:42 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root Sep 05 11:32:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-e4701010-17a2-47a4-910a-80529f09b1ba req-1815543d-dc2b-4144-9c5a-6732786d820a tempest-VolumesSnapshotsTestJSON-1939393310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552.ef38dfd2-fa22-4cf0-a7ea-235e866cd1bb" returned: 0 in 0.844s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:32:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-e4701010-17a2-47a4-910a-80529f09b1ba req-1815543d-dc2b-4144-9c5a-6732786d820a tempest-VolumesSnapshotsTestJSON-1939393310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552.ef38dfd2-fa22-4cf0-a7ea-235e866cd1bb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:32:42 devstack sudo[89285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552.ef38dfd2-fa22-4cf0-a7ea-235e866cd1bb Sep 05 11:32:42 devstack sudo[89285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:32:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-e4701010-17a2-47a4-910a-80529f09b1ba req-1815543d-dc2b-4144-9c5a-6732786d820a tempest-VolumesSnapshotsTestJSON-1939393310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552.ef38dfd2-fa22-4cf0-a7ea-235e866cd1bb" returned: 0 in 0.657s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:32:43 devstack sudo[89285]: pam_unix(sudo:session): session closed for user root Sep 05 11:32:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-e4701010-17a2-47a4-910a-80529f09b1ba req-1815543d-dc2b-4144-9c5a-6732786d820a tempest-VolumesSnapshotsTestJSON-1939393310 None] Lock "cinder-quobyte-ef38dfd2-fa22-4cf0-a7ea-235e866cd1bb" released by "_delete_snapshot" :: held 3.743s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:32:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-e4701010-17a2-47a4-910a-80529f09b1ba req-1815543d-dc2b-4144-9c5a-6732786d820a tempest-VolumesSnapshotsTestJSON-1939393310 None] Lock "cinder-quobyte-7ba94e9e-37c0-4d31-8de3-1ef79a135552" released by "delete_snapshot" :: held 3.816s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:32:43 devstack cinder-volume[87517]: WARNING cinder.quota [req-e4701010-17a2-47a4-910a-80529f09b1ba req-1815543d-dc2b-4144-9c5a-6732786d820a tempest-VolumesSnapshotsTestJSON-1939393310 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:32:43 devstack cinder-volume[87517]: WARNING cinder.quota [req-e4701010-17a2-47a4-910a-80529f09b1ba req-1815543d-dc2b-4144-9c5a-6732786d820a tempest-VolumesSnapshotsTestJSON-1939393310 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:32:43 devstack cinder-volume[87517]: DEBUG cinder.quota [req-e4701010-17a2-47a4-910a-80529f09b1ba req-1815543d-dc2b-4144-9c5a-6732786d820a tempest-VolumesSnapshotsTestJSON-1939393310 None] Created reservations ['7c97266f-856b-49b0-9ff6-e2897156b7c3', 'f7bbc05d-07d3-4bab-8e09-2db9921ac98a', 'db5fef19-6ddf-4e8b-a3b3-f05eff1dc2f1', 'e9faf2bf-f35d-43e9-bf9d-1a31edc93736'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:32:43 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-e4701010-17a2-47a4-910a-80529f09b1ba req-1815543d-dc2b-4144-9c5a-6732786d820a tempest-VolumesSnapshotsTestJSON-1939393310 None] Delete snapshot completed successfully. Sep 05 11:32:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-e4701010-17a2-47a4-910a-80529f09b1ba req-1815543d-dc2b-4144-9c5a-6732786d820a tempest-VolumesSnapshotsTestJSON-1939393310 None] Lock "cinder-ef38dfd2-fa22-4cf0-a7ea-235e866cd1bb-delete_snapshot" released by "delete_snapshot" :: held 4.234s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:32:45 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-88ce8035-8656-4fc9-8a01-564826be4eba req-bb7824e2-8602-4ed1-a518-4da7a77632b1 tempest-DeleteServersTestJSON-664891014 None] Terminate volume connection completed successfully. Sep 05 11:32:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-88ce8035-8656-4fc9-8a01-564826be4eba req-bb7824e2-8602-4ed1-a518-4da7a77632b1 tempest-DeleteServersTestJSON-664891014 None] Deleting attachment c3fd2e5b-7c03-4607-b719-a1d8fc42d833. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 11:32:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-cbb2db96-9957-436f-97a3-26a3ef036b04 req-e1c568f1-60ce-4d7c-8986-0ca012d574ad tempest-VolumesSnapshotsTestJSON-1939393310 None] Acquiring lock "cinder-7ba94e9e-37c0-4d31-8de3-1ef79a135552-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:32:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-cbb2db96-9957-436f-97a3-26a3ef036b04 req-e1c568f1-60ce-4d7c-8986-0ca012d574ad tempest-VolumesSnapshotsTestJSON-1939393310 None] Lock "cinder-7ba94e9e-37c0-4d31-8de3-1ef79a135552-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:32:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-cbb2db96-9957-436f-97a3-26a3ef036b04 req-e1c568f1-60ce-4d7c-8986-0ca012d574ad tempest-VolumesSnapshotsTestJSON-1939393310 None] Acquiring lock "cinder-quobyte-7ba94e9e-37c0-4d31-8de3-1ef79a135552" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:32:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-cbb2db96-9957-436f-97a3-26a3ef036b04 req-e1c568f1-60ce-4d7c-8986-0ca012d574ad tempest-VolumesSnapshotsTestJSON-1939393310 None] Lock "cinder-quobyte-7ba94e9e-37c0-4d31-8de3-1ef79a135552" acquired by "delete_volume" :: waited 0.031s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:32:46 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[367d00c3-4696-49a2-ae2a-61dd1d0694a5]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:32:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-cbb2db96-9957-436f-97a3-26a3ef036b04 req-e1c568f1-60ce-4d7c-8986-0ca012d574ad tempest-VolumesSnapshotsTestJSON-1939393310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:32:46 devstack sudo[89362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552 Sep 05 11:32:46 devstack sudo[89362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:32:46 devstack sudo[89362]: pam_unix(sudo:session): session closed for user root Sep 05 11:32:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-cbb2db96-9957-436f-97a3-26a3ef036b04 req-e1c568f1-60ce-4d7c-8986-0ca012d574ad tempest-VolumesSnapshotsTestJSON-1939393310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552" returned: 0 in 0.458s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:32:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-cbb2db96-9957-436f-97a3-26a3ef036b04 req-e1c568f1-60ce-4d7c-8986-0ca012d574ad tempest-VolumesSnapshotsTestJSON-1939393310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:32:46 devstack sudo[89367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552 Sep 05 11:32:46 devstack sudo[89367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:32:47 devstack sudo[89367]: pam_unix(sudo:session): session closed for user root Sep 05 11:32:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-cbb2db96-9957-436f-97a3-26a3ef036b04 req-e1c568f1-60ce-4d7c-8986-0ca012d574ad tempest-VolumesSnapshotsTestJSON-1939393310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7ba94e9e-37c0-4d31-8de3-1ef79a135552" returned: 0 in 0.302s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:32:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-cbb2db96-9957-436f-97a3-26a3ef036b04 req-e1c568f1-60ce-4d7c-8986-0ca012d574ad tempest-VolumesSnapshotsTestJSON-1939393310 None] Lock "cinder-quobyte-7ba94e9e-37c0-4d31-8de3-1ef79a135552" released by "delete_volume" :: held 0.857s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:32:47 devstack cinder-volume[87517]: WARNING cinder.quota [req-cbb2db96-9957-436f-97a3-26a3ef036b04 req-e1c568f1-60ce-4d7c-8986-0ca012d574ad tempest-VolumesSnapshotsTestJSON-1939393310 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:32:47 devstack cinder-volume[87517]: DEBUG cinder.quota [req-cbb2db96-9957-436f-97a3-26a3ef036b04 req-e1c568f1-60ce-4d7c-8986-0ca012d574ad tempest-VolumesSnapshotsTestJSON-1939393310 None] Created reservations ['4c39fd6b-7e94-4cfb-b7cd-9af00462ab80', '7b7ace80-38d2-45f2-8dde-95a6c12ef276', '03b7c02b-26e8-4e05-b6ae-2d062f7de2e5', 'b8c945cd-d1d1-4a27-befa-6dcf758755f4'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:32:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b5fb29d9-2249-488b-8e01-d8159da3c16d tempest-DeleteServersTestJSON-664891014 None] Acquiring lock "cinder-52590547-84b7-4636-b784-488b5e9c99ac-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:32:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b5fb29d9-2249-488b-8e01-d8159da3c16d tempest-DeleteServersTestJSON-664891014 None] Lock "cinder-52590547-84b7-4636-b784-488b5e9c99ac-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:32:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-cbb2db96-9957-436f-97a3-26a3ef036b04 req-e1c568f1-60ce-4d7c-8986-0ca012d574ad tempest-VolumesSnapshotsTestJSON-1939393310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:32:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-cbb2db96-9957-436f-97a3-26a3ef036b04 req-e1c568f1-60ce-4d7c-8986-0ca012d574ad tempest-VolumesSnapshotsTestJSON-1939393310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:32:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-cbb2db96-9957-436f-97a3-26a3ef036b04 req-e1c568f1-60ce-4d7c-8986-0ca012d574ad tempest-VolumesSnapshotsTestJSON-1939393310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:32:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-cbb2db96-9957-436f-97a3-26a3ef036b04 req-e1c568f1-60ce-4d7c-8986-0ca012d574ad tempest-VolumesSnapshotsTestJSON-1939393310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:32:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-cbb2db96-9957-436f-97a3-26a3ef036b04 req-e1c568f1-60ce-4d7c-8986-0ca012d574ad tempest-VolumesSnapshotsTestJSON-1939393310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:32:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-cbb2db96-9957-436f-97a3-26a3ef036b04 req-e1c568f1-60ce-4d7c-8986-0ca012d574ad tempest-VolumesSnapshotsTestJSON-1939393310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:32:47 devstack sudo[89370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:32:47 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:32:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b5fb29d9-2249-488b-8e01-d8159da3c16d tempest-DeleteServersTestJSON-664891014 None] Acquiring lock "cinder-quobyte-52590547-84b7-4636-b784-488b5e9c99ac" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:32:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e4e4159e-7a48-4dc1-a61e-edbd96c32a96 tempest-ServerRescueNegativeTestJSON-693767323 None] Acquiring lock "cinder-9ccb5aba-884e-489b-84f8-b5bc2a3b2dac-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:32:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b5fb29d9-2249-488b-8e01-d8159da3c16d tempest-DeleteServersTestJSON-664891014 None] Lock "cinder-quobyte-52590547-84b7-4636-b784-488b5e9c99ac" acquired by "delete_volume" :: waited 0.055s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:32:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e4e4159e-7a48-4dc1-a61e-edbd96c32a96 tempest-ServerRescueNegativeTestJSON-693767323 None] Lock "cinder-9ccb5aba-884e-489b-84f8-b5bc2a3b2dac-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:32:47 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fa95db-3bbb-4a05-8ca2-7392710e0d29]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:32:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5fb29d9-2249-488b-8e01-d8159da3c16d tempest-DeleteServersTestJSON-664891014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-52590547-84b7-4636-b784-488b5e9c99ac {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:32:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e4e4159e-7a48-4dc1-a61e-edbd96c32a96 tempest-ServerRescueNegativeTestJSON-693767323 None] Acquiring lock "cinder-quobyte-9ccb5aba-884e-489b-84f8-b5bc2a3b2dac" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:32:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e4e4159e-7a48-4dc1-a61e-edbd96c32a96 tempest-ServerRescueNegativeTestJSON-693767323 None] Lock "cinder-quobyte-9ccb5aba-884e-489b-84f8-b5bc2a3b2dac" acquired by "delete_volume" :: waited 0.041s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:32:47 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a007b78d-53b3-46ad-aa9c-fdea1f17b287]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:32:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e4e4159e-7a48-4dc1-a61e-edbd96c32a96 tempest-ServerRescueNegativeTestJSON-693767323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9ccb5aba-884e-489b-84f8-b5bc2a3b2dac {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:32:47 devstack sudo[89372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-52590547-84b7-4636-b784-488b5e9c99ac Sep 05 11:32:47 devstack sudo[89372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:32:48 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root Sep 05 11:32:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-cbb2db96-9957-436f-97a3-26a3ef036b04 req-e1c568f1-60ce-4d7c-8986-0ca012d574ad tempest-VolumesSnapshotsTestJSON-1939393310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.666s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:32:48 devstack cinder-volume[87517]: DEBUG cinder.manager [req-cbb2db96-9957-436f-97a3-26a3ef036b04 req-e1c568f1-60ce-4d7c-8986-0ca012d574ad tempest-VolumesSnapshotsTestJSON-1939393310 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:32:48 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-cbb2db96-9957-436f-97a3-26a3ef036b04 req-e1c568f1-60ce-4d7c-8986-0ca012d574ad tempest-VolumesSnapshotsTestJSON-1939393310 None] Deleted volume successfully. Sep 05 11:32:48 devstack sudo[89373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9ccb5aba-884e-489b-84f8-b5bc2a3b2dac Sep 05 11:32:48 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:32:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-cbb2db96-9957-436f-97a3-26a3ef036b04 req-e1c568f1-60ce-4d7c-8986-0ca012d574ad tempest-VolumesSnapshotsTestJSON-1939393310 None] Lock "cinder-7ba94e9e-37c0-4d31-8de3-1ef79a135552-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:32:48 devstack sudo[89372]: pam_unix(sudo:session): session closed for user root Sep 05 11:32:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5fb29d9-2249-488b-8e01-d8159da3c16d tempest-DeleteServersTestJSON-664891014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-52590547-84b7-4636-b784-488b5e9c99ac" returned: 0 in 0.779s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:32:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5fb29d9-2249-488b-8e01-d8159da3c16d tempest-DeleteServersTestJSON-664891014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-52590547-84b7-4636-b784-488b5e9c99ac {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:32:48 devstack sudo[89381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-52590547-84b7-4636-b784-488b5e9c99ac Sep 05 11:32:48 devstack sudo[89381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:32:48 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root Sep 05 11:32:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e4e4159e-7a48-4dc1-a61e-edbd96c32a96 tempest-ServerRescueNegativeTestJSON-693767323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9ccb5aba-884e-489b-84f8-b5bc2a3b2dac" returned: 0 in 0.781s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:32:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e4e4159e-7a48-4dc1-a61e-edbd96c32a96 tempest-ServerRescueNegativeTestJSON-693767323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9ccb5aba-884e-489b-84f8-b5bc2a3b2dac {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:32:48 devstack sudo[89385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9ccb5aba-884e-489b-84f8-b5bc2a3b2dac Sep 05 11:32:48 devstack sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:32:48 devstack sudo[89381]: pam_unix(sudo:session): session closed for user root Sep 05 11:32:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5fb29d9-2249-488b-8e01-d8159da3c16d tempest-DeleteServersTestJSON-664891014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-52590547-84b7-4636-b784-488b5e9c99ac" returned: 0 in 0.592s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:32:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b5fb29d9-2249-488b-8e01-d8159da3c16d tempest-DeleteServersTestJSON-664891014 None] Lock "cinder-quobyte-52590547-84b7-4636-b784-488b5e9c99ac" released by "delete_volume" :: held 1.462s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:32:48 devstack sudo[89385]: pam_unix(sudo:session): session closed for user root Sep 05 11:32:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e4e4159e-7a48-4dc1-a61e-edbd96c32a96 tempest-ServerRescueNegativeTestJSON-693767323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9ccb5aba-884e-489b-84f8-b5bc2a3b2dac" returned: 0 in 0.455s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:32:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e4e4159e-7a48-4dc1-a61e-edbd96c32a96 tempest-ServerRescueNegativeTestJSON-693767323 None] Lock "cinder-quobyte-9ccb5aba-884e-489b-84f8-b5bc2a3b2dac" released by "delete_volume" :: held 1.316s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:32:49 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-b5fb29d9-2249-488b-8e01-d8159da3c16d tempest-DeleteServersTestJSON-664891014 None] Created reservations ['16c6a8e4-b68f-453b-bd5c-ef2fa4fbf517', '2e91356e-ff55-46ec-99df-56fc1d02fe43', '7cd622f0-1bbb-4520-a4c6-5af0008e3902', 'a90c0127-261b-42da-bba4-084e3e8e5f30'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:32:49 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-e4e4159e-7a48-4dc1-a61e-edbd96c32a96 tempest-ServerRescueNegativeTestJSON-693767323 None] Created reservations ['e4c476e0-7068-4254-af5b-357922a0604f', '3664c59f-7b48-4b67-b828-d1f45d67a6a2', 'bb03bc80-14d4-47c0-b879-af7ab8697386', '9aa27e80-585e-4ab8-ba46-06f71fb7d710'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:32:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b5fb29d9-2249-488b-8e01-d8159da3c16d tempest-DeleteServersTestJSON-664891014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:32:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b5fb29d9-2249-488b-8e01-d8159da3c16d tempest-DeleteServersTestJSON-664891014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:32:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b5fb29d9-2249-488b-8e01-d8159da3c16d tempest-DeleteServersTestJSON-664891014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:32:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b5fb29d9-2249-488b-8e01-d8159da3c16d tempest-DeleteServersTestJSON-664891014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:32:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b5fb29d9-2249-488b-8e01-d8159da3c16d tempest-DeleteServersTestJSON-664891014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:32:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5fb29d9-2249-488b-8e01-d8159da3c16d tempest-DeleteServersTestJSON-664891014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:32:49 devstack sudo[89389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:32:49 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:32:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e4e4159e-7a48-4dc1-a61e-edbd96c32a96 tempest-ServerRescueNegativeTestJSON-693767323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:32:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e4e4159e-7a48-4dc1-a61e-edbd96c32a96 tempest-ServerRescueNegativeTestJSON-693767323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:32:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e4e4159e-7a48-4dc1-a61e-edbd96c32a96 tempest-ServerRescueNegativeTestJSON-693767323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:32:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e4e4159e-7a48-4dc1-a61e-edbd96c32a96 tempest-ServerRescueNegativeTestJSON-693767323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:32:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e4e4159e-7a48-4dc1-a61e-edbd96c32a96 tempest-ServerRescueNegativeTestJSON-693767323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:32:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e4e4159e-7a48-4dc1-a61e-edbd96c32a96 tempest-ServerRescueNegativeTestJSON-693767323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:32:49 devstack sudo[89391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:32:49 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:32:49 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root Sep 05 11:32:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5fb29d9-2249-488b-8e01-d8159da3c16d tempest-DeleteServersTestJSON-664891014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.525s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:32:49 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-b5fb29d9-2249-488b-8e01-d8159da3c16d tempest-DeleteServersTestJSON-664891014 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:32:49 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b5fb29d9-2249-488b-8e01-d8159da3c16d tempest-DeleteServersTestJSON-664891014 None] Deleted volume successfully. Sep 05 11:32:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b5fb29d9-2249-488b-8e01-d8159da3c16d tempest-DeleteServersTestJSON-664891014 None] Lock "cinder-52590547-84b7-4636-b784-488b5e9c99ac-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:32:50 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root Sep 05 11:32:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e4e4159e-7a48-4dc1-a61e-edbd96c32a96 tempest-ServerRescueNegativeTestJSON-693767323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.738s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:32:50 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-e4e4159e-7a48-4dc1-a61e-edbd96c32a96 tempest-ServerRescueNegativeTestJSON-693767323 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:32:50 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e4e4159e-7a48-4dc1-a61e-edbd96c32a96 tempest-ServerRescueNegativeTestJSON-693767323 None] Deleted volume successfully. Sep 05 11:32:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e4e4159e-7a48-4dc1-a61e-edbd96c32a96 tempest-ServerRescueNegativeTestJSON-693767323 None] Lock "cinder-9ccb5aba-884e-489b-84f8-b5bc2a3b2dac-delete_volume" released by "delete_volume" :: held 2.601s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:32:59 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=41,cinder:UPDATE=45,cinder:INSERT=13,cinder:DELETE=4 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:33:00 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=38,cinder:SELECT=34,cinder:DELETE=3,cinder:INSERT=7 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:33:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:33:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:33:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:33:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:33:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:33:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:33:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:33:32 devstack sudo[89520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:33:32 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:33:32 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root Sep 05 11:33:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.377s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:33:32 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:33:34 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:33:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] Flow 'volume_create_manager' (ea805d25-5b4f-4f9e-88c3-a01b031fae57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:33:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3322d41a-ca20-4be0-8188-3bdfaf45b5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:33:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3322d41a-ca20-4be0-8188-3bdfaf45b5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1756435397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943a4e38-05fa-4b46-bee5-9a629e5d2c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c6a6eab7044ff28818654571cad22e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:33:35Z,use_quota=True,user_id='25d96b728da14431abf6d5a3ab98fb7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:33:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b9953e-408e-49c6-a06f-fad99de5a0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:33:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b9953e-408e-49c6-a06f-fad99de5a0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:33:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42e57560-7428-489c-b053-10b4e5cfc637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:33:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42e57560-7428-489c-b053-10b4e5cfc637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '943a4e38-05fa-4b46-bee5-9a629e5d2c91', 'volume_name': 'volume-943a4e38-05fa-4b46-bee5-9a629e5d2c91', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:33:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e13484-77f4-450e-95aa-d58ca9cf050b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:33:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e13484-77f4-450e-95aa-d58ca9cf050b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:33:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa3e030c-a299-47ec-93ac-65dbd142c5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:33:35 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] Volume 943a4e38-05fa-4b46-bee5-9a629e5d2c91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-943a4e38-05fa-4b46-bee5-9a629e5d2c91', 'volume_size': 1} Sep 05 11:33:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:33:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:33:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1756435397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943a4e38-05fa-4b46-bee5-9a629e5d2c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c6a6eab7044ff28818654571cad22e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:33:35Z,use_quota=True,user_id='25d96b728da14431abf6d5a3ab98fb7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:33:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] Creating volume 943a4e38-05fa-4b46-bee5-9a629e5d2c91 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:33:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:33:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:33:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:33:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:33:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:33:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:33:35 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:33:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-943a4e38-05fa-4b46-bee5-9a629e5d2c91 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:33:35 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-943a4e38-05fa-4b46-bee5-9a629e5d2c91 1073741824 Sep 05 11:33:35 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:33:35 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Sep 05 11:33:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-943a4e38-05fa-4b46-bee5-9a629e5d2c91 1073741824" returned: 0 in 0.507s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:33:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-943a4e38-05fa-4b46-bee5-9a629e5d2c91 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:33:35 devstack sudo[89551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-943a4e38-05fa-4b46-bee5-9a629e5d2c91 Sep 05 11:33:35 devstack sudo[89551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:33:35 devstack sudo[89551]: pam_unix(sudo:session): session closed for user root Sep 05 11:33:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-943a4e38-05fa-4b46-bee5-9a629e5d2c91" returned: 0 in 0.321s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:33:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:33:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:33:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa3e030c-a299-47ec-93ac-65dbd142c5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-943a4e38-05fa-4b46-bee5-9a629e5d2c91', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:33:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed0980ad-e614-4deb-a5b3-2c144cf17826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:33:35 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] Volume volume-943a4e38-05fa-4b46-bee5-9a629e5d2c91 (943a4e38-05fa-4b46-bee5-9a629e5d2c91): created successfully Sep 05 11:33:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed0980ad-e614-4deb-a5b3-2c144cf17826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:33:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] Flow 'volume_create_manager' (ea805d25-5b4f-4f9e-88c3-a01b031fae57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:33:36 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-0041d7d0-af87-402f-8244-0e95473bbd32 tempest-VolumeQuotasAdminTestJSON-452325740 None] Created volume successfully. Sep 05 11:33:36 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:33:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] Flow 'volume_create_manager' (7162e53f-1ff8-4866-aeb0-39b02b3ac749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:33:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32dcfe3b-6d6a-4fc6-ad61-e9071a99a8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:33:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32dcfe3b-6d6a-4fc6-ad61-e9071a99a8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1971498895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6825f511-1f1f-4736-ab23-8f4be4844746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c596a6620b75405db6d55d0d4fc3b614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:33:37Z,use_quota=True,user_id='8071db83482b4ba59b97505bbef1740c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:33:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e0a90f-5ab5-4310-a1e8-96318ca106b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:33:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e0a90f-5ab5-4310-a1e8-96318ca106b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:33:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a845b24-8cfa-4315-9946-a93f15640f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:33:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a845b24-8cfa-4315-9946-a93f15640f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6825f511-1f1f-4736-ab23-8f4be4844746', 'volume_name': 'volume-6825f511-1f1f-4736-ab23-8f4be4844746', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:33:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c09ce29c-8002-41e3-8676-5f956e47dd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:33:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c09ce29c-8002-41e3-8676-5f956e47dd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:33:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc221892-131b-4325-9daf-38acbf85f6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:33:36 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] Volume 6825f511-1f1f-4736-ab23-8f4be4844746: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6825f511-1f1f-4736-ab23-8f4be4844746', 'volume_size': 1} Sep 05 11:33:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:33:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:33:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1971498895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6825f511-1f1f-4736-ab23-8f4be4844746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c596a6620b75405db6d55d0d4fc3b614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:33:37Z,use_quota=True,user_id='8071db83482b4ba59b97505bbef1740c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:33:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] Creating volume 6825f511-1f1f-4736-ab23-8f4be4844746 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:33:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:33:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:33:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:33:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:33:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:33:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:33:36 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:33:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6825f511-1f1f-4736-ab23-8f4be4844746 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:33:36 devstack sudo[89558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6825f511-1f1f-4736-ab23-8f4be4844746 1073741824 Sep 05 11:33:36 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:33:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-503352cf-cf5f-439d-abcc-33af74b7ae98 tempest-VolumeQuotasAdminTestJSON-452325740 None] Acquiring lock "cinder-943a4e38-05fa-4b46-bee5-9a629e5d2c91-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:33:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-503352cf-cf5f-439d-abcc-33af74b7ae98 tempest-VolumeQuotasAdminTestJSON-452325740 None] Lock "cinder-943a4e38-05fa-4b46-bee5-9a629e5d2c91-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:33:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-503352cf-cf5f-439d-abcc-33af74b7ae98 tempest-VolumeQuotasAdminTestJSON-452325740 None] Acquiring lock "cinder-quobyte-943a4e38-05fa-4b46-bee5-9a629e5d2c91" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:33:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-503352cf-cf5f-439d-abcc-33af74b7ae98 tempest-VolumeQuotasAdminTestJSON-452325740 None] Lock "cinder-quobyte-943a4e38-05fa-4b46-bee5-9a629e5d2c91" acquired by "delete_volume" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:33:37 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c5d387-b787-411f-bc82-f422bd9e6e10]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:33:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-503352cf-cf5f-439d-abcc-33af74b7ae98 tempest-VolumeQuotasAdminTestJSON-452325740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-943a4e38-05fa-4b46-bee5-9a629e5d2c91 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:33:37 devstack sudo[89564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-943a4e38-05fa-4b46-bee5-9a629e5d2c91 Sep 05 11:33:37 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:33:37 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root Sep 05 11:33:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6825f511-1f1f-4736-ab23-8f4be4844746 1073741824" returned: 0 in 0.690s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:33:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6825f511-1f1f-4736-ab23-8f4be4844746 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:33:37 devstack sudo[89568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6825f511-1f1f-4736-ab23-8f4be4844746 Sep 05 11:33:37 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:33:37 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root Sep 05 11:33:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-503352cf-cf5f-439d-abcc-33af74b7ae98 tempest-VolumeQuotasAdminTestJSON-452325740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-943a4e38-05fa-4b46-bee5-9a629e5d2c91" returned: 0 in 0.540s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:33:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-503352cf-cf5f-439d-abcc-33af74b7ae98 tempest-VolumeQuotasAdminTestJSON-452325740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-943a4e38-05fa-4b46-bee5-9a629e5d2c91 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:33:37 devstack sudo[89574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-943a4e38-05fa-4b46-bee5-9a629e5d2c91 Sep 05 11:33:37 devstack sudo[89574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:33:38 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root Sep 05 11:33:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6825f511-1f1f-4736-ab23-8f4be4844746" returned: 0 in 0.299s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:33:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:33:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:33:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc221892-131b-4325-9daf-38acbf85f6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6825f511-1f1f-4736-ab23-8f4be4844746', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:33:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2648847-ed05-426b-b92f-a39a3f271bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:33:38 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] Volume volume-6825f511-1f1f-4736-ab23-8f4be4844746 (6825f511-1f1f-4736-ab23-8f4be4844746): created successfully Sep 05 11:33:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2648847-ed05-426b-b92f-a39a3f271bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:33:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] Flow 'volume_create_manager' (7162e53f-1ff8-4866-aeb0-39b02b3ac749) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:33:38 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-fb71432d-9e39-4f5b-af2f-d2d8f5a680ad tempest-TaggedAttachmentsTest-280340949 None] Created volume successfully. Sep 05 11:33:38 devstack sudo[89574]: pam_unix(sudo:session): session closed for user root Sep 05 11:33:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-503352cf-cf5f-439d-abcc-33af74b7ae98 tempest-VolumeQuotasAdminTestJSON-452325740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-943a4e38-05fa-4b46-bee5-9a629e5d2c91" returned: 0 in 0.283s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:33:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-503352cf-cf5f-439d-abcc-33af74b7ae98 tempest-VolumeQuotasAdminTestJSON-452325740 None] Lock "cinder-quobyte-943a4e38-05fa-4b46-bee5-9a629e5d2c91" released by "delete_volume" :: held 0.871s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:33:38 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-503352cf-cf5f-439d-abcc-33af74b7ae98 tempest-VolumeQuotasAdminTestJSON-452325740 None] Created reservations ['1751bdc2-0f7b-415c-be40-936b753b90d6', 'c9db9091-4ff2-47d6-be24-56d9e52652c4', 'ff265020-5cf5-44b0-a6fe-6ed30c260e7b', '72f6b7c3-f048-4c4b-915f-066f70f48598'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:33:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-503352cf-cf5f-439d-abcc-33af74b7ae98 tempest-VolumeQuotasAdminTestJSON-452325740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:33:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-503352cf-cf5f-439d-abcc-33af74b7ae98 tempest-VolumeQuotasAdminTestJSON-452325740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:33:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-503352cf-cf5f-439d-abcc-33af74b7ae98 tempest-VolumeQuotasAdminTestJSON-452325740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:33:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-503352cf-cf5f-439d-abcc-33af74b7ae98 tempest-VolumeQuotasAdminTestJSON-452325740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:33:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-503352cf-cf5f-439d-abcc-33af74b7ae98 tempest-VolumeQuotasAdminTestJSON-452325740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:33:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-503352cf-cf5f-439d-abcc-33af74b7ae98 tempest-VolumeQuotasAdminTestJSON-452325740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:33:38 devstack sudo[89578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:33:38 devstack sudo[89578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:33:38 devstack sudo[89578]: pam_unix(sudo:session): session closed for user root Sep 05 11:33:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-503352cf-cf5f-439d-abcc-33af74b7ae98 tempest-VolumeQuotasAdminTestJSON-452325740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.296s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:33:38 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-503352cf-cf5f-439d-abcc-33af74b7ae98 tempest-VolumeQuotasAdminTestJSON-452325740 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:33:38 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-503352cf-cf5f-439d-abcc-33af74b7ae98 tempest-VolumeQuotasAdminTestJSON-452325740 None] Deleted volume successfully. Sep 05 11:33:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-503352cf-cf5f-439d-abcc-33af74b7ae98 tempest-VolumeQuotasAdminTestJSON-452325740 None] Lock "cinder-943a4e38-05fa-4b46-bee5-9a629e5d2c91-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:33:39 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:33:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] Flow 'volume_create_manager' (b0ff13ad-164b-40c2-a2aa-1c88472a32b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:33:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece5b732-8580-4947-9dec-995e84c481af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:33:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece5b732-8580-4947-9dec-995e84c481af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-530656529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=402e3685-a75d-429d-8a90-0bf4a5901f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c6a6eab7044ff28818654571cad22e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:33:39Z,use_quota=True,user_id='25d96b728da14431abf6d5a3ab98fb7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:33:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438ea4f8-4999-4d39-84ff-c3780f737cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:33:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438ea4f8-4999-4d39-84ff-c3780f737cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:33:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21646ef8-32e2-42fd-a1b1-2b0b51ba4f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:33:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21646ef8-32e2-42fd-a1b1-2b0b51ba4f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '402e3685-a75d-429d-8a90-0bf4a5901f7f', 'volume_name': 'volume-402e3685-a75d-429d-8a90-0bf4a5901f7f', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:33:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa39ae35-1f9e-4d0d-b59f-73d13d2a0e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:33:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa39ae35-1f9e-4d0d-b59f-73d13d2a0e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:33:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (001a8b77-075d-49db-8ec7-910ca5c5b552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:33:39 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] Volume 402e3685-a75d-429d-8a90-0bf4a5901f7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-402e3685-a75d-429d-8a90-0bf4a5901f7f', 'volume_size': 1} Sep 05 11:33:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:33:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:33:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-530656529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=402e3685-a75d-429d-8a90-0bf4a5901f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c6a6eab7044ff28818654571cad22e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:33:39Z,use_quota=True,user_id='25d96b728da14431abf6d5a3ab98fb7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:33:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] Creating volume 402e3685-a75d-429d-8a90-0bf4a5901f7f {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:33:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:33:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:33:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:33:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:33:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:33:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:33:39 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:33:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-402e3685-a75d-429d-8a90-0bf4a5901f7f 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:33:39 devstack sudo[89584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-402e3685-a75d-429d-8a90-0bf4a5901f7f 1073741824 Sep 05 11:33:39 devstack sudo[89584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:33:39 devstack sudo[89584]: pam_unix(sudo:session): session closed for user root Sep 05 11:33:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-402e3685-a75d-429d-8a90-0bf4a5901f7f 1073741824" returned: 0 in 0.477s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:33:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-402e3685-a75d-429d-8a90-0bf4a5901f7f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:33:39 devstack sudo[89590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-402e3685-a75d-429d-8a90-0bf4a5901f7f Sep 05 11:33:39 devstack sudo[89590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:33:40 devstack sudo[89590]: pam_unix(sudo:session): session closed for user root Sep 05 11:33:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-402e3685-a75d-429d-8a90-0bf4a5901f7f" returned: 0 in 0.336s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:33:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:33:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:33:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (001a8b77-075d-49db-8ec7-910ca5c5b552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-402e3685-a75d-429d-8a90-0bf4a5901f7f', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:33:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97203263-a227-4160-bafc-59a38c8c8c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:33:40 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] Volume volume-402e3685-a75d-429d-8a90-0bf4a5901f7f (402e3685-a75d-429d-8a90-0bf4a5901f7f): created successfully Sep 05 11:33:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97203263-a227-4160-bafc-59a38c8c8c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:33:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] Flow 'volume_create_manager' (b0ff13ad-164b-40c2-a2aa-1c88472a32b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:33:40 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-69f59428-2519-439b-bb8a-e5cd0f236625 tempest-VolumeQuotasAdminTestJSON-452325740 None] Created volume successfully. Sep 05 11:33:41 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7e858db3-6940-4273-a534-af76f05cdb77 tempest-VolumeQuotasAdminTestJSON-872430923 None] Transfer volume completed successfully. Sep 05 11:33:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-042b5ef1-2a4b-4549-a89d-6f152a95db9a tempest-VolumeQuotasAdminTestJSON-105272643 None] Acquiring lock "cinder-402e3685-a75d-429d-8a90-0bf4a5901f7f-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:33:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-042b5ef1-2a4b-4549-a89d-6f152a95db9a tempest-VolumeQuotasAdminTestJSON-105272643 None] Lock "cinder-402e3685-a75d-429d-8a90-0bf4a5901f7f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:33:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-042b5ef1-2a4b-4549-a89d-6f152a95db9a tempest-VolumeQuotasAdminTestJSON-105272643 None] Acquiring lock "cinder-quobyte-402e3685-a75d-429d-8a90-0bf4a5901f7f" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:33:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-042b5ef1-2a4b-4549-a89d-6f152a95db9a tempest-VolumeQuotasAdminTestJSON-105272643 None] Lock "cinder-quobyte-402e3685-a75d-429d-8a90-0bf4a5901f7f" acquired by "delete_volume" :: waited 0.037s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:33:42 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[369981dd-3c93-425d-a45b-79693c269b13]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:33:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-042b5ef1-2a4b-4549-a89d-6f152a95db9a tempest-VolumeQuotasAdminTestJSON-105272643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-402e3685-a75d-429d-8a90-0bf4a5901f7f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:33:42 devstack sudo[89595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-402e3685-a75d-429d-8a90-0bf4a5901f7f Sep 05 11:33:42 devstack sudo[89595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:33:43 devstack sudo[89595]: pam_unix(sudo:session): session closed for user root Sep 05 11:33:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-042b5ef1-2a4b-4549-a89d-6f152a95db9a tempest-VolumeQuotasAdminTestJSON-105272643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-402e3685-a75d-429d-8a90-0bf4a5901f7f" returned: 0 in 0.492s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:33:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-042b5ef1-2a4b-4549-a89d-6f152a95db9a tempest-VolumeQuotasAdminTestJSON-105272643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-402e3685-a75d-429d-8a90-0bf4a5901f7f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:33:43 devstack sudo[89600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-402e3685-a75d-429d-8a90-0bf4a5901f7f Sep 05 11:33:43 devstack sudo[89600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:33:43 devstack sudo[89600]: pam_unix(sudo:session): session closed for user root Sep 05 11:33:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-042b5ef1-2a4b-4549-a89d-6f152a95db9a tempest-VolumeQuotasAdminTestJSON-105272643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-402e3685-a75d-429d-8a90-0bf4a5901f7f" returned: 0 in 0.393s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:33:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-042b5ef1-2a4b-4549-a89d-6f152a95db9a tempest-VolumeQuotasAdminTestJSON-105272643 None] Lock "cinder-quobyte-402e3685-a75d-429d-8a90-0bf4a5901f7f" released by "delete_volume" :: held 0.965s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:33:43 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-042b5ef1-2a4b-4549-a89d-6f152a95db9a tempest-VolumeQuotasAdminTestJSON-105272643 None] Created reservations ['d50907de-866a-43f2-b270-83ba09d447eb', '61292d56-f6a2-4129-9970-e0e39cbbd691', 'dbaa7aef-8e93-44d5-9cf7-bcfb4cd18b78', '9fafb4e1-8ada-403c-9a99-cfc278ba8b24'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:33:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-042b5ef1-2a4b-4549-a89d-6f152a95db9a tempest-VolumeQuotasAdminTestJSON-105272643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:33:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-042b5ef1-2a4b-4549-a89d-6f152a95db9a tempest-VolumeQuotasAdminTestJSON-105272643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:33:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-042b5ef1-2a4b-4549-a89d-6f152a95db9a tempest-VolumeQuotasAdminTestJSON-105272643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:33:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-042b5ef1-2a4b-4549-a89d-6f152a95db9a tempest-VolumeQuotasAdminTestJSON-105272643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:33:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-042b5ef1-2a4b-4549-a89d-6f152a95db9a tempest-VolumeQuotasAdminTestJSON-105272643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:33:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-042b5ef1-2a4b-4549-a89d-6f152a95db9a tempest-VolumeQuotasAdminTestJSON-105272643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:33:44 devstack sudo[89636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:33:44 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:33:44 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root Sep 05 11:33:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-042b5ef1-2a4b-4549-a89d-6f152a95db9a tempest-VolumeQuotasAdminTestJSON-105272643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.466s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:33:44 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-042b5ef1-2a4b-4549-a89d-6f152a95db9a tempest-VolumeQuotasAdminTestJSON-105272643 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:33:44 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-042b5ef1-2a4b-4549-a89d-6f152a95db9a tempest-VolumeQuotasAdminTestJSON-105272643 None] Deleted volume successfully. Sep 05 11:33:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-042b5ef1-2a4b-4549-a89d-6f152a95db9a tempest-VolumeQuotasAdminTestJSON-105272643 None] Lock "cinder-402e3685-a75d-429d-8a90-0bf4a5901f7f-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:33:53 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=18,cinder:INSERT=7,cinder:UPDATE=25,cinder:DELETE=1 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:33:54 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=26,cinder:SELECT=16,cinder:DELETE=4,cinder:INSERT=4 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:34:15 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:34:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] Flow 'volume_create_manager' (5b25de9c-b793-4d1e-b2fb-8ab2711c5bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:34:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (948572e0-3a24-423d-a425-f28049ceba4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:34:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (948572e0-3a24-423d-a425-f28049ceba4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1859107255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d36a3b09-3bcc-4e18-8c49-161225eb4e06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70084528dad348afaa86be3c8e9f3f88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:34:15Z,use_quota=True,user_id='66ed48f004fb47799bebeb869ae65b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:34:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c78a030-cbec-4747-97a5-4a450e77108f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:34:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c78a030-cbec-4747-97a5-4a450e77108f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:34:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fbd2df3-43d5-4ddd-8d24-1cee20a98412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:34:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fbd2df3-43d5-4ddd-8d24-1cee20a98412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd36a3b09-3bcc-4e18-8c49-161225eb4e06', 'volume_name': 'volume-d36a3b09-3bcc-4e18-8c49-161225eb4e06', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:34:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c10f7027-1e39-4263-9ac5-5d156ef4ae08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:34:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c10f7027-1e39-4263-9ac5-5d156ef4ae08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:34:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9739514-dbc7-4a48-a9c9-fdaa2b532945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:34:15 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] Volume d36a3b09-3bcc-4e18-8c49-161225eb4e06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d36a3b09-3bcc-4e18-8c49-161225eb4e06', 'volume_size': 1} Sep 05 11:34:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:34:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:34:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1859107255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d36a3b09-3bcc-4e18-8c49-161225eb4e06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70084528dad348afaa86be3c8e9f3f88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:34:15Z,use_quota=True,user_id='66ed48f004fb47799bebeb869ae65b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:34:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] Creating volume d36a3b09-3bcc-4e18-8c49-161225eb4e06 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:34:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:34:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:34:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:34:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:34:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:34:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:34:15 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:34:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d36a3b09-3bcc-4e18-8c49-161225eb4e06 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:15 devstack sudo[90028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d36a3b09-3bcc-4e18-8c49-161225eb4e06 1073741824 Sep 05 11:34:15 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:16 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d36a3b09-3bcc-4e18-8c49-161225eb4e06 1073741824" returned: 0 in 0.762s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d36a3b09-3bcc-4e18-8c49-161225eb4e06 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:16 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d36a3b09-3bcc-4e18-8c49-161225eb4e06 Sep 05 11:34:16 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:16 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d36a3b09-3bcc-4e18-8c49-161225eb4e06" returned: 0 in 0.286s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:34:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:34:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9739514-dbc7-4a48-a9c9-fdaa2b532945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d36a3b09-3bcc-4e18-8c49-161225eb4e06', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:34:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f8cbb4-8cf5-49c1-8634-8d5ecd8290c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:34:16 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] Volume volume-d36a3b09-3bcc-4e18-8c49-161225eb4e06 (d36a3b09-3bcc-4e18-8c49-161225eb4e06): created successfully Sep 05 11:34:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f8cbb4-8cf5-49c1-8634-8d5ecd8290c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:34:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] Flow 'volume_create_manager' (5b25de9c-b793-4d1e-b2fb-8ab2711c5bcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:34:16 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-bd648d52-0d96-471f-8e55-9a9288d13820 tempest-ServersNegativeTestJSON-1894686313 None] Created volume successfully. Sep 05 11:34:18 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:34:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] Flow 'volume_create_manager' (e9188672-6907-4de2-b9d6-a65bfc9df1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:34:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d7c2ef-c6f6-49d7-8f47-86ceb19d1193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:34:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d7c2ef-c6f6-49d7-8f47-86ceb19d1193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-124448541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97529e25-f2d2-48d4-b951-cb79749498a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d369460b29f412ea34e5b2bbf0dffb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:34:18Z,use_quota=True,user_id='48a8fb736f454b219acecf5c74be1612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:34:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e148e0ba-de05-4650-a35d-21f6d2de4f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:34:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e148e0ba-de05-4650-a35d-21f6d2de4f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:34:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a4da93-b122-401a-bae6-34c3ba3ff8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:34:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a4da93-b122-401a-bae6-34c3ba3ff8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97529e25-f2d2-48d4-b951-cb79749498a5', 'volume_name': 'volume-97529e25-f2d2-48d4-b951-cb79749498a5', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:34:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d96e15e-58e2-4c08-a5f9-10de4d911f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:34:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d96e15e-58e2-4c08-a5f9-10de4d911f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:34:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64bf2f62-43b4-4388-b7d6-98f68ce9b2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:34:18 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] Volume 97529e25-f2d2-48d4-b951-cb79749498a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97529e25-f2d2-48d4-b951-cb79749498a5', 'volume_size': 1} Sep 05 11:34:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:34:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:34:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-124448541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97529e25-f2d2-48d4-b951-cb79749498a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d369460b29f412ea34e5b2bbf0dffb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:34:18Z,use_quota=True,user_id='48a8fb736f454b219acecf5c74be1612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:34:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] Creating volume 97529e25-f2d2-48d4-b951-cb79749498a5 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:34:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:34:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:34:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:34:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:34:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:34:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:34:18 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:34:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-97529e25-f2d2-48d4-b951-cb79749498a5 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:18 devstack sudo[90038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-97529e25-f2d2-48d4-b951-cb79749498a5 1073741824 Sep 05 11:34:18 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:19 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-97529e25-f2d2-48d4-b951-cb79749498a5 1073741824" returned: 0 in 0.560s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-97529e25-f2d2-48d4-b951-cb79749498a5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:19 devstack sudo[90044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-97529e25-f2d2-48d4-b951-cb79749498a5 Sep 05 11:34:19 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:19 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:34:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] Flow 'volume_create_manager' (12724c45-0e1f-4d3f-811a-ea1c812f5511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:34:19 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62fde580-e752-4bb8-8e81-f454a8626783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:34:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-97529e25-f2d2-48d4-b951-cb79749498a5" returned: 0 in 0.456s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:34:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:34:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62fde580-e752-4bb8-8e81-f454a8626783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1966725034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=423ef40a-2d69-4dcd-9f2f-7dee1ea21511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70084528dad348afaa86be3c8e9f3f88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:34:20Z,use_quota=True,user_id='66ed48f004fb47799bebeb869ae65b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:34:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf54585e-1975-441c-bc5e-d288bc7de004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:34:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf54585e-1975-441c-bc5e-d288bc7de004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:34:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a199a557-89e3-45d2-84d4-f0b3b18a1966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:34:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a199a557-89e3-45d2-84d4-f0b3b18a1966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '423ef40a-2d69-4dcd-9f2f-7dee1ea21511', 'volume_name': 'volume-423ef40a-2d69-4dcd-9f2f-7dee1ea21511', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:34:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9281baac-6f06-43d8-a2c1-207492f1f018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:34:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9281baac-6f06-43d8-a2c1-207492f1f018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:34:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc7ecf7-5520-470a-ab07-37c58342fe5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:34:19 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] Volume 423ef40a-2d69-4dcd-9f2f-7dee1ea21511: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-423ef40a-2d69-4dcd-9f2f-7dee1ea21511', 'volume_size': 1} Sep 05 11:34:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:34:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:34:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1966725034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=423ef40a-2d69-4dcd-9f2f-7dee1ea21511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70084528dad348afaa86be3c8e9f3f88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:34:20Z,use_quota=True,user_id='66ed48f004fb47799bebeb869ae65b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:34:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] Creating volume 423ef40a-2d69-4dcd-9f2f-7dee1ea21511 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:34:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:34:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:34:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:34:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:34:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:34:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:34:19 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:34:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-423ef40a-2d69-4dcd-9f2f-7dee1ea21511 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64bf2f62-43b4-4388-b7d6-98f68ce9b2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97529e25-f2d2-48d4-b951-cb79749498a5', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:34:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e489267e-5519-4177-98d5-88f2c2955bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:34:19 devstack sudo[90047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-423ef40a-2d69-4dcd-9f2f-7dee1ea21511 1073741824 Sep 05 11:34:19 devstack sudo[90047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:19 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] Volume volume-97529e25-f2d2-48d4-b951-cb79749498a5 (97529e25-f2d2-48d4-b951-cb79749498a5): created successfully Sep 05 11:34:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e489267e-5519-4177-98d5-88f2c2955bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:34:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] Flow 'volume_create_manager' (e9188672-6907-4de2-b9d6-a65bfc9df1b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:34:19 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-add7bc72-1686-4c2c-b903-98d66cbd6116 tempest-VolumesAdminNegativeTest-1131537227 None] Created volume successfully. Sep 05 11:34:20 devstack sudo[90047]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-423ef40a-2d69-4dcd-9f2f-7dee1ea21511 1073741824" returned: 0 in 0.481s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-423ef40a-2d69-4dcd-9f2f-7dee1ea21511 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:20 devstack sudo[90052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-423ef40a-2d69-4dcd-9f2f-7dee1ea21511 Sep 05 11:34:20 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:20 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-423ef40a-2d69-4dcd-9f2f-7dee1ea21511" returned: 0 in 0.282s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:34:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:34:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc7ecf7-5520-470a-ab07-37c58342fe5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-423ef40a-2d69-4dcd-9f2f-7dee1ea21511', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:34:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b94b475-97c7-4b92-94ed-db86cc30b6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:34:20 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] Volume volume-423ef40a-2d69-4dcd-9f2f-7dee1ea21511 (423ef40a-2d69-4dcd-9f2f-7dee1ea21511): created successfully Sep 05 11:34:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b94b475-97c7-4b92-94ed-db86cc30b6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:34:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] Flow 'volume_create_manager' (12724c45-0e1f-4d3f-811a-ea1c812f5511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:34:20 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a956f5a3-b7f1-4a36-9b0e-5e07f2826f77 tempest-ServersNegativeTestJSON-1894686313 None] Created volume successfully. Sep 05 11:34:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8d74eb73-6fe1-43e4-96f4-0c7893358b02 tempest-VolumesAdminNegativeTest-1131537227 None] Acquiring lock "cinder-97529e25-f2d2-48d4-b951-cb79749498a5-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:34:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8d74eb73-6fe1-43e4-96f4-0c7893358b02 tempest-VolumesAdminNegativeTest-1131537227 None] Lock "cinder-97529e25-f2d2-48d4-b951-cb79749498a5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:34:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8d74eb73-6fe1-43e4-96f4-0c7893358b02 tempest-VolumesAdminNegativeTest-1131537227 None] Acquiring lock "cinder-quobyte-97529e25-f2d2-48d4-b951-cb79749498a5" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:34:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8d74eb73-6fe1-43e4-96f4-0c7893358b02 tempest-VolumesAdminNegativeTest-1131537227 None] Lock "cinder-quobyte-97529e25-f2d2-48d4-b951-cb79749498a5" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:34:21 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cd340e-64da-4145-bf54-7a82dfba5024]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:34:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8d74eb73-6fe1-43e4-96f4-0c7893358b02 tempest-VolumesAdminNegativeTest-1131537227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-97529e25-f2d2-48d4-b951-cb79749498a5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:21 devstack sudo[90056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-97529e25-f2d2-48d4-b951-cb79749498a5 Sep 05 11:34:21 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:21 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8d74eb73-6fe1-43e4-96f4-0c7893358b02 tempest-VolumesAdminNegativeTest-1131537227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-97529e25-f2d2-48d4-b951-cb79749498a5" returned: 0 in 0.436s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8d74eb73-6fe1-43e4-96f4-0c7893358b02 tempest-VolumesAdminNegativeTest-1131537227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-97529e25-f2d2-48d4-b951-cb79749498a5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:21 devstack sudo[90062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-97529e25-f2d2-48d4-b951-cb79749498a5 Sep 05 11:34:21 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:22 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8d74eb73-6fe1-43e4-96f4-0c7893358b02 tempest-VolumesAdminNegativeTest-1131537227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-97529e25-f2d2-48d4-b951-cb79749498a5" returned: 0 in 0.459s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8d74eb73-6fe1-43e4-96f4-0c7893358b02 tempest-VolumesAdminNegativeTest-1131537227 None] Lock "cinder-quobyte-97529e25-f2d2-48d4-b951-cb79749498a5" released by "delete_volume" :: held 0.974s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:34:22 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-8d74eb73-6fe1-43e4-96f4-0c7893358b02 tempest-VolumesAdminNegativeTest-1131537227 None] Created reservations ['3bcbdb3a-2dde-4a5d-be20-b6cc8a916291', '25e5e1bf-7194-4e71-85c8-da64051b1b02', '05eab48d-9c07-4f0e-9c45-4e819b4ea51b', '7b204535-1603-4a45-a280-701542537827'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:34:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-34afec26-ef46-4a1c-9036-e76581853629 tempest-ServersNegativeTestJSON-1894686313 None] Acquiring lock "cinder-423ef40a-2d69-4dcd-9f2f-7dee1ea21511-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:34:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-34afec26-ef46-4a1c-9036-e76581853629 tempest-ServersNegativeTestJSON-1894686313 None] Lock "cinder-423ef40a-2d69-4dcd-9f2f-7dee1ea21511-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:34:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-34afec26-ef46-4a1c-9036-e76581853629 tempest-ServersNegativeTestJSON-1894686313 None] Acquiring lock "cinder-quobyte-423ef40a-2d69-4dcd-9f2f-7dee1ea21511" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:34:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8d74eb73-6fe1-43e4-96f4-0c7893358b02 tempest-VolumesAdminNegativeTest-1131537227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:34:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8d74eb73-6fe1-43e4-96f4-0c7893358b02 tempest-VolumesAdminNegativeTest-1131537227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:34:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8d74eb73-6fe1-43e4-96f4-0c7893358b02 tempest-VolumesAdminNegativeTest-1131537227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:34:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8d74eb73-6fe1-43e4-96f4-0c7893358b02 tempest-VolumesAdminNegativeTest-1131537227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:34:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8d74eb73-6fe1-43e4-96f4-0c7893358b02 tempest-VolumesAdminNegativeTest-1131537227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:34:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8d74eb73-6fe1-43e4-96f4-0c7893358b02 tempest-VolumesAdminNegativeTest-1131537227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-34afec26-ef46-4a1c-9036-e76581853629 tempest-ServersNegativeTestJSON-1894686313 None] Lock "cinder-quobyte-423ef40a-2d69-4dcd-9f2f-7dee1ea21511" acquired by "delete_volume" :: waited 0.042s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:34:22 devstack sudo[90099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:34:22 devstack sudo[90099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:22 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e70b94-e5ad-4d98-872e-6f9eb502d06e]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:34:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-34afec26-ef46-4a1c-9036-e76581853629 tempest-ServersNegativeTestJSON-1894686313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-423ef40a-2d69-4dcd-9f2f-7dee1ea21511 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:22 devstack sudo[90101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-423ef40a-2d69-4dcd-9f2f-7dee1ea21511 Sep 05 11:34:22 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:22 devstack sudo[90099]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8d74eb73-6fe1-43e4-96f4-0c7893358b02 tempest-VolumesAdminNegativeTest-1131537227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.414s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:22 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-8d74eb73-6fe1-43e4-96f4-0c7893358b02 tempest-VolumesAdminNegativeTest-1131537227 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:34:22 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-8d74eb73-6fe1-43e4-96f4-0c7893358b02 tempest-VolumesAdminNegativeTest-1131537227 None] Deleted volume successfully. Sep 05 11:34:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8d74eb73-6fe1-43e4-96f4-0c7893358b02 tempest-VolumesAdminNegativeTest-1131537227 None] Lock "cinder-97529e25-f2d2-48d4-b951-cb79749498a5-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:34:23 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-34afec26-ef46-4a1c-9036-e76581853629 tempest-ServersNegativeTestJSON-1894686313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-423ef40a-2d69-4dcd-9f2f-7dee1ea21511" returned: 0 in 0.562s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-34afec26-ef46-4a1c-9036-e76581853629 tempest-ServersNegativeTestJSON-1894686313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-423ef40a-2d69-4dcd-9f2f-7dee1ea21511 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:23 devstack sudo[90109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-423ef40a-2d69-4dcd-9f2f-7dee1ea21511 Sep 05 11:34:23 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:23 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-34afec26-ef46-4a1c-9036-e76581853629 tempest-ServersNegativeTestJSON-1894686313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-423ef40a-2d69-4dcd-9f2f-7dee1ea21511" returned: 0 in 0.436s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-34afec26-ef46-4a1c-9036-e76581853629 tempest-ServersNegativeTestJSON-1894686313 None] Lock "cinder-quobyte-423ef40a-2d69-4dcd-9f2f-7dee1ea21511" released by "delete_volume" :: held 1.081s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:34:23 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-34afec26-ef46-4a1c-9036-e76581853629 tempest-ServersNegativeTestJSON-1894686313 None] Created reservations ['d8d1fb81-c1be-44d3-a429-baa8ff2448ec', 'b8c1f073-1d47-477f-8829-aee66fe80d83', '0be6ec5b-cc16-4c84-a4b3-d67af5491a43', '03a4f484-8897-4180-a8f2-c60120bae2d2'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:34:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-34afec26-ef46-4a1c-9036-e76581853629 tempest-ServersNegativeTestJSON-1894686313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:34:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-34afec26-ef46-4a1c-9036-e76581853629 tempest-ServersNegativeTestJSON-1894686313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:34:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-34afec26-ef46-4a1c-9036-e76581853629 tempest-ServersNegativeTestJSON-1894686313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:34:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-34afec26-ef46-4a1c-9036-e76581853629 tempest-ServersNegativeTestJSON-1894686313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:34:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-34afec26-ef46-4a1c-9036-e76581853629 tempest-ServersNegativeTestJSON-1894686313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:34:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-34afec26-ef46-4a1c-9036-e76581853629 tempest-ServersNegativeTestJSON-1894686313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:23 devstack sudo[90113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:34:23 devstack sudo[90113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:24 devstack sudo[90113]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-34afec26-ef46-4a1c-9036-e76581853629 tempest-ServersNegativeTestJSON-1894686313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.359s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:24 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-34afec26-ef46-4a1c-9036-e76581853629 tempest-ServersNegativeTestJSON-1894686313 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:34:24 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-34afec26-ef46-4a1c-9036-e76581853629 tempest-ServersNegativeTestJSON-1894686313 None] Deleted volume successfully. Sep 05 11:34:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-34afec26-ef46-4a1c-9036-e76581853629 tempest-ServersNegativeTestJSON-1894686313 None] Lock "cinder-423ef40a-2d69-4dcd-9f2f-7dee1ea21511-delete_volume" released by "delete_volume" :: held 1.865s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:34:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ca540d68-109d-4e9d-901c-30e8e4726294 tempest-ServersNegativeTestJSON-1894686313 None] Acquiring lock "cinder-d36a3b09-3bcc-4e18-8c49-161225eb4e06-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:34:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ca540d68-109d-4e9d-901c-30e8e4726294 tempest-ServersNegativeTestJSON-1894686313 None] Lock "cinder-d36a3b09-3bcc-4e18-8c49-161225eb4e06-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:34:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ca540d68-109d-4e9d-901c-30e8e4726294 tempest-ServersNegativeTestJSON-1894686313 None] Acquiring lock "cinder-quobyte-d36a3b09-3bcc-4e18-8c49-161225eb4e06" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:34:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ca540d68-109d-4e9d-901c-30e8e4726294 tempest-ServersNegativeTestJSON-1894686313 None] Lock "cinder-quobyte-d36a3b09-3bcc-4e18-8c49-161225eb4e06" acquired by "delete_volume" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:34:24 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c91b9fa-cde0-47a3-899d-8943bd84d33e]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:34:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca540d68-109d-4e9d-901c-30e8e4726294 tempest-ServersNegativeTestJSON-1894686313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d36a3b09-3bcc-4e18-8c49-161225eb4e06 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:25 devstack sudo[90140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d36a3b09-3bcc-4e18-8c49-161225eb4e06 Sep 05 11:34:25 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:25 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca540d68-109d-4e9d-901c-30e8e4726294 tempest-ServersNegativeTestJSON-1894686313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d36a3b09-3bcc-4e18-8c49-161225eb4e06" returned: 0 in 0.522s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca540d68-109d-4e9d-901c-30e8e4726294 tempest-ServersNegativeTestJSON-1894686313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d36a3b09-3bcc-4e18-8c49-161225eb4e06 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:25 devstack sudo[90147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d36a3b09-3bcc-4e18-8c49-161225eb4e06 Sep 05 11:34:25 devstack sudo[90147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:25 devstack sudo[90147]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca540d68-109d-4e9d-901c-30e8e4726294 tempest-ServersNegativeTestJSON-1894686313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d36a3b09-3bcc-4e18-8c49-161225eb4e06" returned: 0 in 0.397s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ca540d68-109d-4e9d-901c-30e8e4726294 tempest-ServersNegativeTestJSON-1894686313 None] Lock "cinder-quobyte-d36a3b09-3bcc-4e18-8c49-161225eb4e06" released by "delete_volume" :: held 0.962s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:34:25 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-ca540d68-109d-4e9d-901c-30e8e4726294 tempest-ServersNegativeTestJSON-1894686313 None] Created reservations ['83ee533d-2d61-48b5-9141-60d768d539aa', '7201e9cd-ab22-41b5-81d3-18ba04557ae1', '4dde2375-0ee3-4a2d-95bd-33e9b4f1ddb9', '907f1d44-c450-48ac-b417-17f6c29c5da0'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:34:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ca540d68-109d-4e9d-901c-30e8e4726294 tempest-ServersNegativeTestJSON-1894686313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:34:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ca540d68-109d-4e9d-901c-30e8e4726294 tempest-ServersNegativeTestJSON-1894686313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:34:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ca540d68-109d-4e9d-901c-30e8e4726294 tempest-ServersNegativeTestJSON-1894686313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:34:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ca540d68-109d-4e9d-901c-30e8e4726294 tempest-ServersNegativeTestJSON-1894686313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:34:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ca540d68-109d-4e9d-901c-30e8e4726294 tempest-ServersNegativeTestJSON-1894686313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:34:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca540d68-109d-4e9d-901c-30e8e4726294 tempest-ServersNegativeTestJSON-1894686313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:26 devstack sudo[90166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:34:26 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:26 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca540d68-109d-4e9d-901c-30e8e4726294 tempest-ServersNegativeTestJSON-1894686313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.294s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:26 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-ca540d68-109d-4e9d-901c-30e8e4726294 tempest-ServersNegativeTestJSON-1894686313 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:34:26 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ca540d68-109d-4e9d-901c-30e8e4726294 tempest-ServersNegativeTestJSON-1894686313 None] Deleted volume successfully. Sep 05 11:34:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ca540d68-109d-4e9d-901c-30e8e4726294 tempest-ServersNegativeTestJSON-1894686313 None] Lock "cinder-d36a3b09-3bcc-4e18-8c49-161225eb4e06-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:34:28 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:34:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Flow 'volume_create_manager' (78aa506e-da9d-4859-8c53-e55725af1d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:34:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcdf2a7c-5ae8-46fc-afd3-2eb74a7dbbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:34:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcdf2a7c-5ae8-46fc-afd3-2eb74a7dbbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-993742728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbad22e7-fdcd-411b-b0db-3d92a05d27c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5320059820e4f6f8bd1ba05f11b9fa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:34:28Z,use_quota=True,user_id='fe08554563614e3ba2f5c9928b26f921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:34:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0044044-c27d-4f74-8402-730ba189c80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:34:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0044044-c27d-4f74-8402-730ba189c80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:34:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (267118e3-fea3-4088-91bc-244ba4c0b12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:34:28 devstack cinder-volume[87517]: DEBUG cinder.image.glance [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Creating Keystone auth plugin from conf {{(pid=87517) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 11:34:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (267118e3-fea3-4088-91bc-244ba4c0b12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cbad22e7-fdcd-411b-b0db-3d92a05d27c2', 'volume_name': 'volume-cbad22e7-fdcd-411b-b0db-3d92a05d27c2', 'volume_size': 1, 'image_id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c73a992b4ff1451ca3178925081bf687', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'created_at': datetime.datetime(2026, 9, 5, 9, 26, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 9, 26, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:34:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0bd73c8-303e-477a-a084-051c5175ae8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:34:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0bd73c8-303e-477a-a084-051c5175ae8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:34:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66390bb6-2ae8-4e0e-8737-8fc45d1089b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:34:28 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Volume cbad22e7-fdcd-411b-b0db-3d92a05d27c2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cbad22e7-fdcd-411b-b0db-3d92a05d27c2', 'volume_size': 1, 'image_id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c73a992b4ff1451ca3178925081bf687', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'created_at': datetime.datetime(2026, 9, 5, 9, 26, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 9, 26, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 05 11:34:28 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Trying to clone cbad22e7-fdcd-411b-b0db-3d92a05d27c2 from image fff52cc1-bd64-4eb0-8735-62bad8dd7741 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'metadata': {}}]). {{(pid=87517) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 11:34:29 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_ynv3_5bwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 11:34:29 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Image download 20.69 MB at 20.69 MB/s Sep 05 11:34:29 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f734230-de48-46e3-adb7-0c08014b9c68]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:34:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_ynv3_5bwdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:29 devstack sudo[90219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_ynv3_5bwdevstack@QuobyteHD Sep 05 11:34:29 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:29 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_ynv3_5bwdevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:29 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Temporary image fff52cc1-bd64-4eb0-8735-62bad8dd7741 is fetched for user fe08554563614e3ba2f5c9928b26f921. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 11:34:30 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b776be-d9ef-44de-978f-58b2e8e4d920]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:34:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_ynv3_5bwdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:30 devstack sudo[90224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_ynv3_5bwdevstack@QuobyteHD Sep 05 11:34:30 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:30 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_ynv3_5bwdevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:34:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:34:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-993742728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbad22e7-fdcd-411b-b0db-3d92a05d27c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5320059820e4f6f8bd1ba05f11b9fa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:34:28Z,use_quota=True,user_id='fe08554563614e3ba2f5c9928b26f921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:34:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Creating volume cbad22e7-fdcd-411b-b0db-3d92a05d27c2 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:34:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:34:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:34:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:34:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:34:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:34:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:34:30 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:34:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cbad22e7-fdcd-411b-b0db-3d92a05d27c2 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:30 devstack sudo[90229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cbad22e7-fdcd-411b-b0db-3d92a05d27c2 1073741824 Sep 05 11:34:30 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:30 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cbad22e7-fdcd-411b-b0db-3d92a05d27c2 1073741824" returned: 0 in 0.436s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cbad22e7-fdcd-411b-b0db-3d92a05d27c2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:30 devstack sudo[90235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cbad22e7-fdcd-411b-b0db-3d92a05d27c2 Sep 05 11:34:30 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:31 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cbad22e7-fdcd-411b-b0db-3d92a05d27c2" returned: 0 in 0.235s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:34:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:34:31 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Attempting download of fff52cc1-bd64-4eb0-8735-62bad8dd7741 ((None, [{'url': 'file:///opt/stack/data/glance/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'metadata': {}}])) to volume cbad22e7-fdcd-411b-b0db-3d92a05d27c2. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 11:34:31 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e2b233-494f-483d-9d7b-4ee514db6d02]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:34:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741_bkhoatc6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:31 devstack sudo[90240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741_bkhoatc6 Sep 05 11:34:31 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:31 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741_bkhoatc6" returned: 0 in 0.360s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741_bkhoatc6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:31 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741_bkhoatc6 Sep 05 11:34:31 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:31 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741_bkhoatc6" returned: 1 in 0.412s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741_bkhoatc6' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 11:34:31 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4e5f74-d979-4779-8206-f50374453fcf]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:34:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_ynv3_5bwdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:32 devstack sudo[90248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_ynv3_5bwdevstack@QuobyteHD Sep 05 11:34:32 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:34:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:34:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:34:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:34:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:34:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:34:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:32 devstack sudo[90251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:34:32 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:32 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_ynv3_5bwdevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:32 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] fff52cc1-bd64-4eb0-8735-62bad8dd7741 was qcow2, converting to qcow2 {{(pid=87517) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 11:34:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_ynv3_5bwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cbad22e7-fdcd-411b-b0db-3d92a05d27c2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:32 devstack sudo[90256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_ynv3_5bwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cbad22e7-fdcd-411b-b0db-3d92a05d27c2 Sep 05 11:34:32 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:32 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.274s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:32 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:34:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:34:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread count: 28 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 11:34:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread info: [<_MainThread(MainThread, started 131707869511808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 11:34:34 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_ynv3_5bwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cbad22e7-fdcd-411b-b0db-3d92a05d27c2" returned: 0 in 2.046s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:34 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_ynv3_5bwdevstack@QuobyteHD, size 112.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cbad22e7-fdcd-411b-b0db-3d92a05d27c2 {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 11:34:34 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Converted 112.00 MB image at 54.71 MB/s Sep 05 11:34:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cbad22e7-fdcd-411b-b0db-3d92a05d27c2 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:34 devstack sudo[90268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cbad22e7-fdcd-411b-b0db-3d92a05d27c2 1G Sep 05 11:34:34 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:34 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cbad22e7-fdcd-411b-b0db-3d92a05d27c2 1G" returned: 0 in 0.373s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:34 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Downloaded image fff52cc1-bd64-4eb0-8735-62bad8dd7741 ((None, [{'url': 'file:///opt/stack/data/glance/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'metadata': {}}])) to volume cbad22e7-fdcd-411b-b0db-3d92a05d27c2 successfully. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 11:34:34 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Temporary image fff52cc1-bd64-4eb0-8735-62bad8dd7741 for user fe08554563614e3ba2f5c9928b26f921 is deleted. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 11:34:34 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Marking volume cbad22e7-fdcd-411b-b0db-3d92a05d27c2 as bootable. {{(pid=87517) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 11:34:34 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Copying metadata from image fff52cc1-bd64-4eb0-8735-62bad8dd7741 to cbad22e7-fdcd-411b-b0db-3d92a05d27c2. {{(pid=87517) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 11:34:34 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Creating volume glance metadata for volume cbad22e7-fdcd-411b-b0db-3d92a05d27c2 backed by image fff52cc1-bd64-4eb0-8735-62bad8dd7741 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87517) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 11:34:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66390bb6-2ae8-4e0e-8737-8fc45d1089b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbad22e7-fdcd-411b-b0db-3d92a05d27c2', 'volume_size': 1, 'image_id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c73a992b4ff1451ca3178925081bf687', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'created_at': datetime.datetime(2026, 9, 5, 9, 26, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 9, 26, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:34:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bde22fd-76d6-4993-a5d3-0bb4f7e89034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:34:34 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Volume volume-cbad22e7-fdcd-411b-b0db-3d92a05d27c2 (cbad22e7-fdcd-411b-b0db-3d92a05d27c2): created successfully Sep 05 11:34:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bde22fd-76d6-4993-a5d3-0bb4f7e89034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:34:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Flow 'volume_create_manager' (78aa506e-da9d-4859-8c53-e55725af1d91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:34:34 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c3cd1e6c-7166-4a16-b75d-419e752a66e2 tempest-VolumesImageMetadata-113084604 None] Created volume successfully. Sep 05 11:34:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-70a3fc23-15bb-4e55-8574-ac5afd80882c tempest-VolumesImageMetadata-113084604 None] Acquiring lock "cinder-cbad22e7-fdcd-411b-b0db-3d92a05d27c2-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:34:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-70a3fc23-15bb-4e55-8574-ac5afd80882c tempest-VolumesImageMetadata-113084604 None] Lock "cinder-cbad22e7-fdcd-411b-b0db-3d92a05d27c2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:34:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-70a3fc23-15bb-4e55-8574-ac5afd80882c tempest-VolumesImageMetadata-113084604 None] Acquiring lock "cinder-quobyte-cbad22e7-fdcd-411b-b0db-3d92a05d27c2" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:34:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-70a3fc23-15bb-4e55-8574-ac5afd80882c tempest-VolumesImageMetadata-113084604 None] Lock "cinder-quobyte-cbad22e7-fdcd-411b-b0db-3d92a05d27c2" acquired by "delete_volume" :: waited 0.028s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:34:36 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b4f8eb-bfc4-4018-8f17-e3956ad3c5ba]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:34:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-70a3fc23-15bb-4e55-8574-ac5afd80882c tempest-VolumesImageMetadata-113084604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cbad22e7-fdcd-411b-b0db-3d92a05d27c2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:36 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cbad22e7-fdcd-411b-b0db-3d92a05d27c2 Sep 05 11:34:36 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:37 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-70a3fc23-15bb-4e55-8574-ac5afd80882c tempest-VolumesImageMetadata-113084604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cbad22e7-fdcd-411b-b0db-3d92a05d27c2" returned: 0 in 0.707s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-70a3fc23-15bb-4e55-8574-ac5afd80882c tempest-VolumesImageMetadata-113084604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cbad22e7-fdcd-411b-b0db-3d92a05d27c2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:37 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cbad22e7-fdcd-411b-b0db-3d92a05d27c2 Sep 05 11:34:37 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:37 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-70a3fc23-15bb-4e55-8574-ac5afd80882c tempest-VolumesImageMetadata-113084604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cbad22e7-fdcd-411b-b0db-3d92a05d27c2" returned: 0 in 0.458s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-70a3fc23-15bb-4e55-8574-ac5afd80882c tempest-VolumesImageMetadata-113084604 None] Lock "cinder-quobyte-cbad22e7-fdcd-411b-b0db-3d92a05d27c2" released by "delete_volume" :: held 1.253s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:34:38 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-70a3fc23-15bb-4e55-8574-ac5afd80882c tempest-VolumesImageMetadata-113084604 None] Created reservations ['4d86f25d-e1be-4576-98f7-a8bf074821b7', '959f4aba-2e37-460d-a31f-bf1086892320', '62b37bb8-a561-422a-8cf5-9a5fee3dd308', '69db1034-d681-432d-9e1b-82cc2692e92d'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:34:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-70a3fc23-15bb-4e55-8574-ac5afd80882c tempest-VolumesImageMetadata-113084604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:34:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-70a3fc23-15bb-4e55-8574-ac5afd80882c tempest-VolumesImageMetadata-113084604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:34:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-70a3fc23-15bb-4e55-8574-ac5afd80882c tempest-VolumesImageMetadata-113084604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:34:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-70a3fc23-15bb-4e55-8574-ac5afd80882c tempest-VolumesImageMetadata-113084604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:34:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-70a3fc23-15bb-4e55-8574-ac5afd80882c tempest-VolumesImageMetadata-113084604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:34:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-70a3fc23-15bb-4e55-8574-ac5afd80882c tempest-VolumesImageMetadata-113084604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:38 devstack sudo[90333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:34:38 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:38 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-70a3fc23-15bb-4e55-8574-ac5afd80882c tempest-VolumesImageMetadata-113084604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.426s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:38 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-70a3fc23-15bb-4e55-8574-ac5afd80882c tempest-VolumesImageMetadata-113084604 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:34:38 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-70a3fc23-15bb-4e55-8574-ac5afd80882c tempest-VolumesImageMetadata-113084604 None] Deleted volume successfully. Sep 05 11:34:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-70a3fc23-15bb-4e55-8574-ac5afd80882c tempest-VolumesImageMetadata-113084604 None] Lock "cinder-cbad22e7-fdcd-411b-b0db-3d92a05d27c2-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:34:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-c2a9abe7-5a38-4e64-98c5-b0ddab8560e9 req-c407ba86-997f-46cb-a7c8-bad57fb782a4 tempest-TaggedAttachmentsTest-280340949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:34:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-c2a9abe7-5a38-4e64-98c5-b0ddab8560e9 req-c407ba86-997f-46cb-a7c8-bad57fb782a4 tempest-TaggedAttachmentsTest-280340949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:34:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-c2a9abe7-5a38-4e64-98c5-b0ddab8560e9 req-c407ba86-997f-46cb-a7c8-bad57fb782a4 tempest-TaggedAttachmentsTest-280340949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:34:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-c2a9abe7-5a38-4e64-98c5-b0ddab8560e9 req-c407ba86-997f-46cb-a7c8-bad57fb782a4 tempest-TaggedAttachmentsTest-280340949 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32', 'name': 'volume-6825f511-1f1f-4736-ab23-8f4be4844746', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2cda9967-bb43-417c-9d5e-c7c277bcdc27', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 11:34:40 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-c2a9abe7-5a38-4e64-98c5-b0ddab8560e9 req-c407ba86-997f-46cb-a7c8-bad57fb782a4 tempest-TaggedAttachmentsTest-280340949 None] attachment_update completed successfully. Sep 05 11:34:45 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-3c439ec4-87cd-48c8-9c3d-89593f0f8f51 req-c028f9a0-b806-46c9-b142-d584a2730f9a tempest-TaggedAttachmentsTest-280340949 None] Terminate volume connection completed successfully. Sep 05 11:34:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-3c439ec4-87cd-48c8-9c3d-89593f0f8f51 req-c028f9a0-b806-46c9-b142-d584a2730f9a tempest-TaggedAttachmentsTest-280340949 None] Deleting attachment 2cda9967-bb43-417c-9d5e-c7c277bcdc27. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 11:34:51 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:34:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] Flow 'volume_create_manager' (33e2d6da-4c64-42cb-826f-48b5b423df0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:34:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8375e78-8357-4368-9dd8-0bc1a248910f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:34:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8375e78-8357-4368-9dd8-0bc1a248910f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-119966150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d888b53-d4b9-4979-9a15-99729fc557b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b3fd1a1b5134f2bbafa27a5f7852f5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:34:51Z,use_quota=True,user_id='259e9b2df0d145e699992056ff056274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:34:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b50570d3-3369-4da9-83d9-e2ecdfe6b549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:34:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b50570d3-3369-4da9-83d9-e2ecdfe6b549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:34:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d42cc1-a23d-4818-b78e-751bb56110a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:34:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d42cc1-a23d-4818-b78e-751bb56110a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d888b53-d4b9-4979-9a15-99729fc557b3', 'volume_name': 'volume-7d888b53-d4b9-4979-9a15-99729fc557b3', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:34:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0649b8ac-dce1-4c97-aec0-1c366862dcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:34:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0649b8ac-dce1-4c97-aec0-1c366862dcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:34:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acffd4d5-f320-4efa-bf68-472309373302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:34:51 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] Volume 7d888b53-d4b9-4979-9a15-99729fc557b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d888b53-d4b9-4979-9a15-99729fc557b3', 'volume_size': 1} Sep 05 11:34:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:34:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:34:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-119966150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d888b53-d4b9-4979-9a15-99729fc557b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b3fd1a1b5134f2bbafa27a5f7852f5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:34:51Z,use_quota=True,user_id='259e9b2df0d145e699992056ff056274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:34:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] Creating volume 7d888b53-d4b9-4979-9a15-99729fc557b3 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:34:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:34:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:34:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:34:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:34:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:34:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:34:51 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:34:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7d888b53-d4b9-4979-9a15-99729fc557b3 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:51 devstack sudo[90804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7d888b53-d4b9-4979-9a15-99729fc557b3 1073741824 Sep 05 11:34:51 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:52 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7d888b53-d4b9-4979-9a15-99729fc557b3 1073741824" returned: 0 in 0.889s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7d888b53-d4b9-4979-9a15-99729fc557b3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:52 devstack sudo[90811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7d888b53-d4b9-4979-9a15-99729fc557b3 Sep 05 11:34:52 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7d888b53-d4b9-4979-9a15-99729fc557b3" returned: 0 in 0.470s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:52 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:34:52 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:34:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acffd4d5-f320-4efa-bf68-472309373302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d888b53-d4b9-4979-9a15-99729fc557b3', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:34:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d1fc38-3776-4197-8d3b-a4f875cf130f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:34:53 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] Volume volume-7d888b53-d4b9-4979-9a15-99729fc557b3 (7d888b53-d4b9-4979-9a15-99729fc557b3): created successfully Sep 05 11:34:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d1fc38-3776-4197-8d3b-a4f875cf130f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:34:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] Flow 'volume_create_manager' (33e2d6da-4c64-42cb-826f-48b5b423df0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:34:53 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-913657d2-3a2e-4842-9b65-91f1a39ffa46 tempest-AbsoluteLimitsTests-537679443 None] Created volume successfully. Sep 05 11:34:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-168e1c2c-a104-421a-90c4-93512b7dfe5f tempest-AbsoluteLimitsTests-537679443 None] Acquiring lock "cinder-7d888b53-d4b9-4979-9a15-99729fc557b3-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:34:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-168e1c2c-a104-421a-90c4-93512b7dfe5f tempest-AbsoluteLimitsTests-537679443 None] Lock "cinder-7d888b53-d4b9-4979-9a15-99729fc557b3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:34:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-168e1c2c-a104-421a-90c4-93512b7dfe5f tempest-AbsoluteLimitsTests-537679443 None] Acquiring lock "cinder-quobyte-7d888b53-d4b9-4979-9a15-99729fc557b3" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:34:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-168e1c2c-a104-421a-90c4-93512b7dfe5f tempest-AbsoluteLimitsTests-537679443 None] Lock "cinder-quobyte-7d888b53-d4b9-4979-9a15-99729fc557b3" acquired by "delete_volume" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:34:54 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7896dd04-2d39-4203-a63c-244eb170abec]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:34:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-168e1c2c-a104-421a-90c4-93512b7dfe5f tempest-AbsoluteLimitsTests-537679443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7d888b53-d4b9-4979-9a15-99729fc557b3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:54 devstack sudo[90837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7d888b53-d4b9-4979-9a15-99729fc557b3 Sep 05 11:34:54 devstack sudo[90837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:54 devstack sudo[90837]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-168e1c2c-a104-421a-90c4-93512b7dfe5f tempest-AbsoluteLimitsTests-537679443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7d888b53-d4b9-4979-9a15-99729fc557b3" returned: 0 in 0.491s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-168e1c2c-a104-421a-90c4-93512b7dfe5f tempest-AbsoluteLimitsTests-537679443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7d888b53-d4b9-4979-9a15-99729fc557b3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:54 devstack sudo[90843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7d888b53-d4b9-4979-9a15-99729fc557b3 Sep 05 11:34:54 devstack sudo[90843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:55 devstack sudo[90843]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-168e1c2c-a104-421a-90c4-93512b7dfe5f tempest-AbsoluteLimitsTests-537679443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7d888b53-d4b9-4979-9a15-99729fc557b3" returned: 0 in 0.348s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-168e1c2c-a104-421a-90c4-93512b7dfe5f tempest-AbsoluteLimitsTests-537679443 None] Lock "cinder-quobyte-7d888b53-d4b9-4979-9a15-99729fc557b3" released by "delete_volume" :: held 0.936s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:34:55 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-168e1c2c-a104-421a-90c4-93512b7dfe5f tempest-AbsoluteLimitsTests-537679443 None] Created reservations ['921d9b29-a663-4828-bf54-942d62481039', 'c30703e2-6b9f-4f7e-a719-5174d880e109', '97fc4818-55cc-4046-aa2d-d55acf20eaec', '541fe994-18a1-418c-ae17-9c74aca67474'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:34:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-168e1c2c-a104-421a-90c4-93512b7dfe5f tempest-AbsoluteLimitsTests-537679443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:34:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-168e1c2c-a104-421a-90c4-93512b7dfe5f tempest-AbsoluteLimitsTests-537679443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:34:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-168e1c2c-a104-421a-90c4-93512b7dfe5f tempest-AbsoluteLimitsTests-537679443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:34:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-168e1c2c-a104-421a-90c4-93512b7dfe5f tempest-AbsoluteLimitsTests-537679443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:34:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-168e1c2c-a104-421a-90c4-93512b7dfe5f tempest-AbsoluteLimitsTests-537679443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:34:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-168e1c2c-a104-421a-90c4-93512b7dfe5f tempest-AbsoluteLimitsTests-537679443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:34:55 devstack sudo[90846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:34:55 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:34:55 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root Sep 05 11:34:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-168e1c2c-a104-421a-90c4-93512b7dfe5f tempest-AbsoluteLimitsTests-537679443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.308s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:34:55 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-168e1c2c-a104-421a-90c4-93512b7dfe5f tempest-AbsoluteLimitsTests-537679443 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:34:55 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-168e1c2c-a104-421a-90c4-93512b7dfe5f tempest-AbsoluteLimitsTests-537679443 None] Deleted volume successfully. Sep 05 11:34:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-168e1c2c-a104-421a-90c4-93512b7dfe5f tempest-AbsoluteLimitsTests-537679443 None] Lock "cinder-7d888b53-d4b9-4979-9a15-99729fc557b3-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:35:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-698fb524-a202-400f-ad28-e60f49e87b30 tempest-TaggedAttachmentsTest-280340949 None] Acquiring lock "cinder-6825f511-1f1f-4736-ab23-8f4be4844746-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:35:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-698fb524-a202-400f-ad28-e60f49e87b30 tempest-TaggedAttachmentsTest-280340949 None] Lock "cinder-6825f511-1f1f-4736-ab23-8f4be4844746-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:35:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-698fb524-a202-400f-ad28-e60f49e87b30 tempest-TaggedAttachmentsTest-280340949 None] Acquiring lock "cinder-quobyte-6825f511-1f1f-4736-ab23-8f4be4844746" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:35:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-698fb524-a202-400f-ad28-e60f49e87b30 tempest-TaggedAttachmentsTest-280340949 None] Lock "cinder-quobyte-6825f511-1f1f-4736-ab23-8f4be4844746" acquired by "delete_volume" :: waited 0.046s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:35:00 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f69a0be-71ce-40d0-9802-23f524cfb992]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:35:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-698fb524-a202-400f-ad28-e60f49e87b30 tempest-TaggedAttachmentsTest-280340949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6825f511-1f1f-4736-ab23-8f4be4844746 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:00 devstack sudo[90851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6825f511-1f1f-4736-ab23-8f4be4844746 Sep 05 11:35:00 devstack sudo[90851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:00 devstack sudo[90851]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-698fb524-a202-400f-ad28-e60f49e87b30 tempest-TaggedAttachmentsTest-280340949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6825f511-1f1f-4736-ab23-8f4be4844746" returned: 0 in 0.495s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-698fb524-a202-400f-ad28-e60f49e87b30 tempest-TaggedAttachmentsTest-280340949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6825f511-1f1f-4736-ab23-8f4be4844746 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:00 devstack sudo[90859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6825f511-1f1f-4736-ab23-8f4be4844746 Sep 05 11:35:00 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:01 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-698fb524-a202-400f-ad28-e60f49e87b30 tempest-TaggedAttachmentsTest-280340949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6825f511-1f1f-4736-ab23-8f4be4844746" returned: 0 in 0.441s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-698fb524-a202-400f-ad28-e60f49e87b30 tempest-TaggedAttachmentsTest-280340949 None] Lock "cinder-quobyte-6825f511-1f1f-4736-ab23-8f4be4844746" released by "delete_volume" :: held 1.036s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:35:01 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-698fb524-a202-400f-ad28-e60f49e87b30 tempest-TaggedAttachmentsTest-280340949 None] Created reservations ['dce17f6f-2a5b-46c0-8dcb-e86b43409417', '81598b3f-4dee-4c88-8f38-e7caa0bbeb49', '251b6f9e-29d8-4419-84db-6164ab610794', 'ee02f051-f90a-47b2-a0d1-bf8d879fecb4'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:35:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-698fb524-a202-400f-ad28-e60f49e87b30 tempest-TaggedAttachmentsTest-280340949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:35:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-698fb524-a202-400f-ad28-e60f49e87b30 tempest-TaggedAttachmentsTest-280340949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:35:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-698fb524-a202-400f-ad28-e60f49e87b30 tempest-TaggedAttachmentsTest-280340949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:35:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-698fb524-a202-400f-ad28-e60f49e87b30 tempest-TaggedAttachmentsTest-280340949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:35:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-698fb524-a202-400f-ad28-e60f49e87b30 tempest-TaggedAttachmentsTest-280340949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:35:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-698fb524-a202-400f-ad28-e60f49e87b30 tempest-TaggedAttachmentsTest-280340949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:01 devstack sudo[90866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:35:01 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:02 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-698fb524-a202-400f-ad28-e60f49e87b30 tempest-TaggedAttachmentsTest-280340949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.442s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:02 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-698fb524-a202-400f-ad28-e60f49e87b30 tempest-TaggedAttachmentsTest-280340949 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:35:02 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-698fb524-a202-400f-ad28-e60f49e87b30 tempest-TaggedAttachmentsTest-280340949 None] Deleted volume successfully. Sep 05 11:35:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-698fb524-a202-400f-ad28-e60f49e87b30 tempest-TaggedAttachmentsTest-280340949 None] Lock "cinder-6825f511-1f1f-4736-ab23-8f4be4844746-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:35:04 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:35:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] Flow 'volume_create_manager' (e7ff9ccc-2742-4877-a0bc-e9b84e897dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:35:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21881e59-3ab7-4156-8902-c5b44fe9ac9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21881e59-3ab7-4156-8902-c5b44fe9ac9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1039182877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e88d65b4-4f08-40bc-9c25-499a6a71b23b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ce155a889704048b7c594d90d72fc9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:35:05Z,use_quota=True,user_id='c4f2650e381747a793fc103f862191b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf264ca9-f267-4b0c-89e1-4b5dd29c9847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf264ca9-f267-4b0c-89e1-4b5dd29c9847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e75f4847-658a-4306-be38-b72bc79ab69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e75f4847-658a-4306-be38-b72bc79ab69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e88d65b4-4f08-40bc-9c25-499a6a71b23b', 'volume_name': 'volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a93c6bb5-f4e6-4136-886d-24c0b44ae3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a93c6bb5-f4e6-4136-886d-24c0b44ae3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (585cf304-6b7b-4999-b7ae-02dbfe8fd98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:04 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] Volume e88d65b4-4f08-40bc-9c25-499a6a71b23b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b', 'volume_size': 1} Sep 05 11:35:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:35:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:35:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1039182877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e88d65b4-4f08-40bc-9c25-499a6a71b23b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ce155a889704048b7c594d90d72fc9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:35:05Z,use_quota=True,user_id='c4f2650e381747a793fc103f862191b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:35:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] Creating volume e88d65b4-4f08-40bc-9c25-499a6a71b23b {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:35:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:35:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:35:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:35:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:35:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:35:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:35:04 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:35:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:04 devstack sudo[90887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b 1073741824 Sep 05 11:35:04 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:05 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b 1073741824" returned: 0 in 0.546s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:05 devstack sudo[90894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b Sep 05 11:35:05 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:05 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b" returned: 0 in 0.291s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:35:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:35:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (585cf304-6b7b-4999-b7ae-02dbfe8fd98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd5a074a-d187-440e-8d01-97799764355c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:05 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] Volume volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b (e88d65b4-4f08-40bc-9c25-499a6a71b23b): created successfully Sep 05 11:35:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd5a074a-d187-440e-8d01-97799764355c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] Flow 'volume_create_manager' (e7ff9ccc-2742-4877-a0bc-e9b84e897dd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:35:05 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-5b445654-7474-4104-a1b7-431d6c634cd6 tempest-VolumesDeleteCascade-1514737135 None] Created volume successfully. Sep 05 11:35:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b7710a79-f5d9-461d-ae01-bc0a1a63f1b5 tempest-VolumesDeleteCascade-1514737135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:35:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b7710a79-f5d9-461d-ae01-bc0a1a63f1b5 tempest-VolumesDeleteCascade-1514737135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:35:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-b7710a79-f5d9-461d-ae01-bc0a1a63f1b5 tempest-VolumesDeleteCascade-1514737135 None] Creating offline snapshot c77c29a2-af7e-4481-8c9c-303f7f76f794 of volume e88d65b4-4f08-40bc-9c25-499a6a71b23b {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:35:07 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e79cb50-b1a7-4b90-80e7-4697df2f8fa7]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:35:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7710a79-f5d9-461d-ae01-bc0a1a63f1b5 tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:07 devstack sudo[90899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b Sep 05 11:35:07 devstack sudo[90899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:07 devstack sudo[90899]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7710a79-f5d9-461d-ae01-bc0a1a63f1b5 tempest-VolumesDeleteCascade-1514737135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b" returned: 0 in 0.416s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7710a79-f5d9-461d-ae01-bc0a1a63f1b5 tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.c77c29a2-af7e-4481-8c9c-303f7f76f794 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:07 devstack sudo[90904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.c77c29a2-af7e-4481-8c9c-303f7f76f794 1G Sep 05 11:35:07 devstack sudo[90904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:08 devstack sudo[90904]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7710a79-f5d9-461d-ae01-bc0a1a63f1b5 tempest-VolumesDeleteCascade-1514737135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.c77c29a2-af7e-4481-8c9c-303f7f76f794 1G" returned: 0 in 0.777s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7710a79-f5d9-461d-ae01-bc0a1a63f1b5 tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.c77c29a2-af7e-4481-8c9c-303f7f76f794 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:08 devstack sudo[90910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.c77c29a2-af7e-4481-8c9c-303f7f76f794 Sep 05 11:35:08 devstack sudo[90910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:08 devstack sudo[90910]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7710a79-f5d9-461d-ae01-bc0a1a63f1b5 tempest-VolumesDeleteCascade-1514737135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.c77c29a2-af7e-4481-8c9c-303f7f76f794" returned: 0 in 0.381s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:08 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-b7710a79-f5d9-461d-ae01-bc0a1a63f1b5 tempest-VolumesDeleteCascade-1514737135 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.c77c29a2-af7e-4481-8c9c-303f7f76f794 is being set with open permissions: ugo+rw Sep 05 11:35:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7710a79-f5d9-461d-ae01-bc0a1a63f1b5 tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.c77c29a2-af7e-4481-8c9c-303f7f76f794 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:08 devstack sudo[90916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.c77c29a2-af7e-4481-8c9c-303f7f76f794 Sep 05 11:35:08 devstack sudo[90916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:09 devstack sudo[90916]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7710a79-f5d9-461d-ae01-bc0a1a63f1b5 tempest-VolumesDeleteCascade-1514737135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.c77c29a2-af7e-4481-8c9c-303f7f76f794" returned: 0 in 0.287s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7710a79-f5d9-461d-ae01-bc0a1a63f1b5 tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:09 devstack sudo[90919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.info Sep 05 11:35:09 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:09 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7710a79-f5d9-461d-ae01-bc0a1a63f1b5 tempest-VolumesDeleteCascade-1514737135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.info" returned: 0 in 0.282s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:09 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-b7710a79-f5d9-461d-ae01-bc0a1a63f1b5 tempest-VolumesDeleteCascade-1514737135 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.info is being set with open permissions: ugo+rw Sep 05 11:35:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7710a79-f5d9-461d-ae01-bc0a1a63f1b5 tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:09 devstack sudo[90922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.info Sep 05 11:35:09 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:09 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b7710a79-f5d9-461d-ae01-bc0a1a63f1b5 tempest-VolumesDeleteCascade-1514737135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.info" returned: 0 in 0.349s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b7710a79-f5d9-461d-ae01-bc0a1a63f1b5 tempest-VolumesDeleteCascade-1514737135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.634s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:35:09 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b7710a79-f5d9-461d-ae01-bc0a1a63f1b5 tempest-VolumesDeleteCascade-1514737135 None] Create snapshot completed successfully Sep 05 11:35:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b9c25e40-9a27-4e9e-836c-179031c1cde3 tempest-VolumesDeleteCascade-1514737135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:35:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b9c25e40-9a27-4e9e-836c-179031c1cde3 tempest-VolumesDeleteCascade-1514737135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:35:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-b9c25e40-9a27-4e9e-836c-179031c1cde3 tempest-VolumesDeleteCascade-1514737135 None] Creating offline snapshot 3223d196-2054-4bd5-9a84-a664fef4c9df of volume e88d65b4-4f08-40bc-9c25-499a6a71b23b {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:35:10 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc62c27-eed2-44bf-80f7-a34064a3a5ea]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:35:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b9c25e40-9a27-4e9e-836c-179031c1cde3 tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.c77c29a2-af7e-4481-8c9c-303f7f76f794 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:10 devstack sudo[90927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.c77c29a2-af7e-4481-8c9c-303f7f76f794 Sep 05 11:35:10 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:11 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b9c25e40-9a27-4e9e-836c-179031c1cde3 tempest-VolumesDeleteCascade-1514737135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.c77c29a2-af7e-4481-8c9c-303f7f76f794" returned: 0 in 0.526s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-b9c25e40-9a27-4e9e-836c-179031c1cde3 tempest-VolumesDeleteCascade-1514737135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:35:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b9c25e40-9a27-4e9e-836c-179031c1cde3 tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.c77c29a2-af7e-4481-8c9c-303f7f76f794,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.3223d196-2054-4bd5-9a84-a664fef4c9df 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:11 devstack sudo[90934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.c77c29a2-af7e-4481-8c9c-303f7f76f794,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.3223d196-2054-4bd5-9a84-a664fef4c9df 1G Sep 05 11:35:11 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:11 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b9c25e40-9a27-4e9e-836c-179031c1cde3 tempest-VolumesDeleteCascade-1514737135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.c77c29a2-af7e-4481-8c9c-303f7f76f794,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.3223d196-2054-4bd5-9a84-a664fef4c9df 1G" returned: 0 in 0.572s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b9c25e40-9a27-4e9e-836c-179031c1cde3 tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.c77c29a2-af7e-4481-8c9c-303f7f76f794 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.3223d196-2054-4bd5-9a84-a664fef4c9df {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:11 devstack sudo[90941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.c77c29a2-af7e-4481-8c9c-303f7f76f794 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.3223d196-2054-4bd5-9a84-a664fef4c9df Sep 05 11:35:11 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:12 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b9c25e40-9a27-4e9e-836c-179031c1cde3 tempest-VolumesDeleteCascade-1514737135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.c77c29a2-af7e-4481-8c9c-303f7f76f794 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.3223d196-2054-4bd5-9a84-a664fef4c9df" returned: 0 in 0.334s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:12 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-b9c25e40-9a27-4e9e-836c-179031c1cde3 tempest-VolumesDeleteCascade-1514737135 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.3223d196-2054-4bd5-9a84-a664fef4c9df is being set with open permissions: ugo+rw Sep 05 11:35:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b9c25e40-9a27-4e9e-836c-179031c1cde3 tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.3223d196-2054-4bd5-9a84-a664fef4c9df {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:12 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.3223d196-2054-4bd5-9a84-a664fef4c9df Sep 05 11:35:12 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:12 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b9c25e40-9a27-4e9e-836c-179031c1cde3 tempest-VolumesDeleteCascade-1514737135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.3223d196-2054-4bd5-9a84-a664fef4c9df" returned: 0 in 0.293s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b9c25e40-9a27-4e9e-836c-179031c1cde3 tempest-VolumesDeleteCascade-1514737135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.895s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:35:12 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b9c25e40-9a27-4e9e-836c-179031c1cde3 tempest-VolumesDeleteCascade-1514737135 None] Create snapshot completed successfully Sep 05 11:35:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Acquiring lock "cinder-e88d65b4-4f08-40bc-9c25-499a6a71b23b-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:35:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-e88d65b4-4f08-40bc-9c25-499a6a71b23b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:35:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Performing cascade delete. {{(pid=87517) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 05 11:35:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Acquiring lock "cinder-3223d196-2054-4bd5-9a84-a664fef4c9df-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:35:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-3223d196-2054-4bd5-9a84-a664fef4c9df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:35:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Acquiring lock "cinder-quobyte-e88d65b4-4f08-40bc-9c25-499a6a71b23b" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:35:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-quobyte-e88d65b4-4f08-40bc-9c25-499a6a71b23b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:35:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Acquiring lock "cinder-quobyte-3223d196-2054-4bd5-9a84-a664fef4c9df" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:35:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-quobyte-3223d196-2054-4bd5-9a84-a664fef4c9df" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:35:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Deleting offline snapshot 3223d196-2054-4bd5-9a84-a664fef4c9df of volume e88d65b4-4f08-40bc-9c25-499a6a71b23b {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:35:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] snapshot_file for this snap is: volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.3223d196-2054-4bd5-9a84-a664fef4c9df {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:35:13 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee303e9e-5f8a-447a-8803-4228f823a16d]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:35:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.3223d196-2054-4bd5-9a84-a664fef4c9df {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:13 devstack sudo[90984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.3223d196-2054-4bd5-9a84-a664fef4c9df Sep 05 11:35:13 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:13 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.3223d196-2054-4bd5-9a84-a664fef4c9df" returned: 0 in 0.643s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:35:13 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1026b2cd-9f1d-4706-b085-d06620705ecb]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:35:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.c77c29a2-af7e-4481-8c9c-303f7f76f794 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:13 devstack sudo[91017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.c77c29a2-af7e-4481-8c9c-303f7f76f794 Sep 05 11:35:13 devstack sudo[91017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:14 devstack sudo[91017]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.c77c29a2-af7e-4481-8c9c-303f7f76f794" returned: 0 in 0.594s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:35:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.3223d196-2054-4bd5-9a84-a664fef4c9df {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:14 devstack sudo[91026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.3223d196-2054-4bd5-9a84-a664fef4c9df Sep 05 11:35:14 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:15 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.3223d196-2054-4bd5-9a84-a664fef4c9df" returned: 0 in 0.884s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.3223d196-2054-4bd5-9a84-a664fef4c9df {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:15 devstack sudo[91038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.3223d196-2054-4bd5-9a84-a664fef4c9df Sep 05 11:35:15 devstack sudo[91038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:15 devstack sudo[91038]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.3223d196-2054-4bd5-9a84-a664fef4c9df" returned: 0 in 0.381s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-quobyte-3223d196-2054-4bd5-9a84-a664fef4c9df" released by "_delete_snapshot" :: held 2.699s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:35:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-quobyte-e88d65b4-4f08-40bc-9c25-499a6a71b23b" released by "delete_snapshot" :: held 2.743s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:35:15 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=72,cinder:SELECT=62,cinder:DELETE=4,cinder:INSERT=21 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:35:15 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=70,cinder:UPDATE=72,cinder:INSERT=23,cinder:DELETE=10 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:35:15 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Created reservations ['9d4b3f6b-2b9f-44b1-a200-e6394b2af0d6', '8f0e7a49-1d20-4f6f-a6c4-a68c587def91', '640b780d-ae46-4b2a-a625-63d6e54622d6', '24950af5-58c2-4f01-9ea4-eb2432a1174e'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:35:16 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Delete snapshot completed successfully. Sep 05 11:35:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-3223d196-2054-4bd5-9a84-a664fef4c9df-delete_snapshot" released by "delete_snapshot" :: held 3.127s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:35:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Acquiring lock "cinder-c77c29a2-af7e-4481-8c9c-303f7f76f794-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:35:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-c77c29a2-af7e-4481-8c9c-303f7f76f794-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:35:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Acquiring lock "cinder-quobyte-e88d65b4-4f08-40bc-9c25-499a6a71b23b" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:35:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-quobyte-e88d65b4-4f08-40bc-9c25-499a6a71b23b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:35:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Acquiring lock "cinder-quobyte-c77c29a2-af7e-4481-8c9c-303f7f76f794" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:35:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-quobyte-c77c29a2-af7e-4481-8c9c-303f7f76f794" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:35:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Deleting offline snapshot c77c29a2-af7e-4481-8c9c-303f7f76f794 of volume e88d65b4-4f08-40bc-9c25-499a6a71b23b {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:35:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] snapshot_file for this snap is: volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.c77c29a2-af7e-4481-8c9c-303f7f76f794 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:35:16 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aca9431-f9ef-4f59-9f61-79240fcd0bbb]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:35:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.c77c29a2-af7e-4481-8c9c-303f7f76f794 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:16 devstack sudo[91041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.c77c29a2-af7e-4481-8c9c-303f7f76f794 Sep 05 11:35:16 devstack sudo[91041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:16 devstack sudo[91041]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.c77c29a2-af7e-4481-8c9c-303f7f76f794" returned: 0 in 0.589s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:35:16 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7667038f-9d21-449f-8bcb-027128bac1e6]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:35:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:17 devstack sudo[91049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b Sep 05 11:35:17 devstack sudo[91049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:17 devstack sudo[91049]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b" returned: 0 in 0.782s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.c77c29a2-af7e-4481-8c9c-303f7f76f794 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:17 devstack sudo[91055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.c77c29a2-af7e-4481-8c9c-303f7f76f794 Sep 05 11:35:17 devstack sudo[91055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:18 devstack sudo[91055]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.c77c29a2-af7e-4481-8c9c-303f7f76f794" returned: 0 in 0.529s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.c77c29a2-af7e-4481-8c9c-303f7f76f794 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:18 devstack sudo[91065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.c77c29a2-af7e-4481-8c9c-303f7f76f794 Sep 05 11:35:18 devstack sudo[91065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:18 devstack sudo[91065]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b.c77c29a2-af7e-4481-8c9c-303f7f76f794" returned: 0 in 0.478s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-quobyte-c77c29a2-af7e-4481-8c9c-303f7f76f794" released by "_delete_snapshot" :: held 2.566s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:35:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-quobyte-e88d65b4-4f08-40bc-9c25-499a6a71b23b" released by "delete_snapshot" :: held 2.617s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:35:18 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Created reservations ['2ab78154-8ca2-4003-bed1-01e7402c2d5a', '44a47fcc-fe44-4212-8968-508b9938fda7', 'b93f80f3-f13e-4ba0-bbc1-869b4c53b38c', '83cbab74-3d78-4c38-aec3-d97db0bad3d6'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:35:18 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Delete snapshot completed successfully. Sep 05 11:35:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-c77c29a2-af7e-4481-8c9c-303f7f76f794-delete_snapshot" released by "delete_snapshot" :: held 2.837s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:35:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Snapshots deleted, issuing volume delete {{(pid=87517) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 05 11:35:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Acquiring lock "cinder-quobyte-e88d65b4-4f08-40bc-9c25-499a6a71b23b" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:35:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-quobyte-e88d65b4-4f08-40bc-9c25-499a6a71b23b" acquired by "delete_volume" :: waited 0.040s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:35:19 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e266d7-2a3d-4a52-ab5b-a63e1d802ee9]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:35:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:19 devstack sudo[91080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b Sep 05 11:35:19 devstack sudo[91080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:19 devstack sudo[91080]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b" returned: 0 in 0.524s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:19 devstack sudo[91086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b Sep 05 11:35:19 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:19 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e88d65b4-4f08-40bc-9c25-499a6a71b23b" returned: 0 in 0.349s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-quobyte-e88d65b4-4f08-40bc-9c25-499a6a71b23b" released by "delete_volume" :: held 0.968s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:35:20 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Created reservations ['60506d5b-d40c-4a98-9654-4376f764cdfe', 'b391a326-04b2-4ebf-84f9-cc7f11bb053b', 'c2f01ee2-86fd-4763-82f9-527d8b596ffc', 'e86f06df-7325-4ea9-805b-177153ccc8dc'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:35:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:35:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:35:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:35:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:35:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:35:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:20 devstack sudo[91090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:35:20 devstack sudo[91090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:20 devstack sudo[91090]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.446s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:20 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:35:20 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Deleted volume successfully. Sep 05 11:35:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-59543bcc-913b-4d3f-9caf-c801b7db9208 tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-e88d65b4-4f08-40bc-9c25-499a6a71b23b-delete_volume" released by "delete_volume" :: held 7.822s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:35:22 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:35:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] Flow 'volume_create_manager' (93a5a5e9-6aac-4ccf-b63c-c9f2c1120ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:35:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (343095a0-5b2b-4266-a328-e92faae0055e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (343095a0-5b2b-4266-a328-e92faae0055e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-451841544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21f42cf3-0a60-41b4-aafd-305030d05c7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ce155a889704048b7c594d90d72fc9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:35:22Z,use_quota=True,user_id='c4f2650e381747a793fc103f862191b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6df583c-2f03-4744-ba63-8c791a68f63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6df583c-2f03-4744-ba63-8c791a68f63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d7caaa-6250-4538-b221-44beb15c38d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d7caaa-6250-4538-b221-44beb15c38d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21f42cf3-0a60-41b4-aafd-305030d05c7d', 'volume_name': 'volume-21f42cf3-0a60-41b4-aafd-305030d05c7d', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (668f37d6-b93f-475a-980f-2411d207bf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (668f37d6-b93f-475a-980f-2411d207bf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (497bd199-6305-41bc-a535-84f4dd8a0338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:22 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] Volume 21f42cf3-0a60-41b4-aafd-305030d05c7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21f42cf3-0a60-41b4-aafd-305030d05c7d', 'volume_size': 1} Sep 05 11:35:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:35:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:35:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-451841544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21f42cf3-0a60-41b4-aafd-305030d05c7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ce155a889704048b7c594d90d72fc9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:35:22Z,use_quota=True,user_id='c4f2650e381747a793fc103f862191b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:35:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] Creating volume 21f42cf3-0a60-41b4-aafd-305030d05c7d {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:35:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:35:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:35:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:35:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:35:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:35:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:35:22 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:35:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:22 devstack sudo[91097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d 1073741824 Sep 05 11:35:22 devstack sudo[91097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:23 devstack sudo[91097]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d 1073741824" returned: 0 in 1.036s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:23 devstack sudo[91177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d Sep 05 11:35:23 devstack sudo[91177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:24 devstack sudo[91177]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d" returned: 0 in 0.511s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:35:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:35:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (497bd199-6305-41bc-a535-84f4dd8a0338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21f42cf3-0a60-41b4-aafd-305030d05c7d', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddc2aa8-9917-4a64-b47e-6e7c6c667dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:24 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] Volume volume-21f42cf3-0a60-41b4-aafd-305030d05c7d (21f42cf3-0a60-41b4-aafd-305030d05c7d): created successfully Sep 05 11:35:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddc2aa8-9917-4a64-b47e-6e7c6c667dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] Flow 'volume_create_manager' (93a5a5e9-6aac-4ccf-b63c-c9f2c1120ff1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:35:24 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d8176608-6183-43e3-acdd-ecd816d902c3 tempest-VolumesDeleteCascade-1514737135 None] Created volume successfully. Sep 05 11:35:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5252d304-22cb-4e20-8351-4079672e48de tempest-VolumesDeleteCascade-1514737135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:35:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5252d304-22cb-4e20-8351-4079672e48de tempest-VolumesDeleteCascade-1514737135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:35:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-5252d304-22cb-4e20-8351-4079672e48de tempest-VolumesDeleteCascade-1514737135 None] Creating offline snapshot bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc of volume 21f42cf3-0a60-41b4-aafd-305030d05c7d {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:35:25 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d2037f-b435-47aa-a442-ba86118f4248]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:35:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5252d304-22cb-4e20-8351-4079672e48de tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:25 devstack sudo[91211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d Sep 05 11:35:25 devstack sudo[91211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:25 devstack sudo[91211]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5252d304-22cb-4e20-8351-4079672e48de tempest-VolumesDeleteCascade-1514737135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d" returned: 0 in 0.815s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5252d304-22cb-4e20-8351-4079672e48de tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d.bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:26 devstack sudo[91225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d.bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc 1G Sep 05 11:35:26 devstack sudo[91225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:27 devstack sudo[91225]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5252d304-22cb-4e20-8351-4079672e48de tempest-VolumesDeleteCascade-1514737135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d.bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc 1G" returned: 0 in 1.128s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5252d304-22cb-4e20-8351-4079672e48de tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21f42cf3-0a60-41b4-aafd-305030d05c7d -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d.bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:27 devstack sudo[91241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21f42cf3-0a60-41b4-aafd-305030d05c7d -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d.bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc Sep 05 11:35:27 devstack sudo[91241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:27 devstack sudo[91241]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5252d304-22cb-4e20-8351-4079672e48de tempest-VolumesDeleteCascade-1514737135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21f42cf3-0a60-41b4-aafd-305030d05c7d -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d.bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc" returned: 0 in 0.701s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:27 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-5252d304-22cb-4e20-8351-4079672e48de tempest-VolumesDeleteCascade-1514737135 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d.bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc is being set with open permissions: ugo+rw Sep 05 11:35:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5252d304-22cb-4e20-8351-4079672e48de tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d.bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:27 devstack sudo[91269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d.bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc Sep 05 11:35:27 devstack sudo[91269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:28 devstack sudo[91269]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5252d304-22cb-4e20-8351-4079672e48de tempest-VolumesDeleteCascade-1514737135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d.bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc" returned: 0 in 0.430s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5252d304-22cb-4e20-8351-4079672e48de tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:28 devstack sudo[91272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d.info Sep 05 11:35:28 devstack sudo[91272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:28 devstack sudo[91272]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5252d304-22cb-4e20-8351-4079672e48de tempest-VolumesDeleteCascade-1514737135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d.info" returned: 0 in 0.405s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:28 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-5252d304-22cb-4e20-8351-4079672e48de tempest-VolumesDeleteCascade-1514737135 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d.info is being set with open permissions: ugo+rw Sep 05 11:35:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5252d304-22cb-4e20-8351-4079672e48de tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:28 devstack sudo[91275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d.info Sep 05 11:35:28 devstack sudo[91275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:29 devstack sudo[91275]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5252d304-22cb-4e20-8351-4079672e48de tempest-VolumesDeleteCascade-1514737135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d.info" returned: 0 in 0.413s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5252d304-22cb-4e20-8351-4079672e48de tempest-VolumesDeleteCascade-1514737135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.035s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:35:29 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-5252d304-22cb-4e20-8351-4079672e48de tempest-VolumesDeleteCascade-1514737135 None] Create snapshot completed successfully Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Flow 'volume_create_manager' (112d113b-005d-443a-b1ba-e75fb44844c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67c42138-eeed-4f24-8f6c-e730215e87d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67c42138-eeed-4f24-8f6c-e730215e87d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-384476367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24962101-99ae-4a57-8aef-c1a703b5046c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ce155a889704048b7c594d90d72fc9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:35:30Z,use_quota=True,user_id='c4f2650e381747a793fc103f862191b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a6a0f80-0d16-4d15-8fcb-54892e9ced81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a6a0f80-0d16-4d15-8fcb-54892e9ced81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87c218ea-0f20-41ca-885e-e62e3f514528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87c218ea-0f20-41ca-885e-e62e3f514528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '24962101-99ae-4a57-8aef-c1a703b5046c', 'volume_name': 'volume-24962101-99ae-4a57-8aef-c1a703b5046c', 'volume_size': 1, 'snapshot_id': 'bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (332c8bdb-c89f-4e9e-95fa-717dcead86fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (332c8bdb-c89f-4e9e-95fa-717dcead86fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5826bf9c-0fb1-416e-97be-37cee7a41de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:30 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Volume 24962101-99ae-4a57-8aef-c1a703b5046c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-24962101-99ae-4a57-8aef-c1a703b5046c', 'volume_size': 1, 'snapshot_id': 'bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc'} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Acquiring lock "cinder-quobyte-bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc-24962101-99ae-4a57-8aef-c1a703b5046c" by "_create_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-quobyte-bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc-24962101-99ae-4a57-8aef-c1a703b5046c" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Creating volume 24962101-99ae-4a57-8aef-c1a703b5046c from snapshot bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc {{(pid=87517) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Acquiring lock "cinder-quobyte-24962101-99ae-4a57-8aef-c1a703b5046c" by "_copy_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-quobyte-24962101-99ae-4a57-8aef-c1a703b5046c" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] snapshot: bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc, volume: 24962101-99ae-4a57-8aef-c1a703b5046c, {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede8349c-98e2-4b93-95dd-94fa9cb793fc]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d.bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:30 devstack sudo[91281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d.bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc Sep 05 11:35:30 devstack sudo[91281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:30 devstack sudo[91281]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d.bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc" returned: 0 in 0.399s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21f42cf3-0a60-41b4-aafd-305030d05c7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fddb7f-fecc-4cc9-9612-308e73386ab2]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:35:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:30 devstack sudo[91286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d Sep 05 11:35:30 devstack sudo[91286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:31 devstack sudo[91286]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d" returned: 0 in 0.443s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 11:35:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Creating direct copy from snapshot {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 11:35:31 devstack cinder-volume[87517]: DEBUG cinder.utils [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Path /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-24962101-99ae-4a57-8aef-c1a703b5046c not found in is_blk_device check {{(pid=87517) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 11:35:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-24962101-99ae-4a57-8aef-c1a703b5046c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:31 devstack sudo[91292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-24962101-99ae-4a57-8aef-c1a703b5046c Sep 05 11:35:31 devstack sudo[91292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:35:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:35:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:35:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:35:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:35:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:35:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:32 devstack sudo[91324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:35:32 devstack sudo[91324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:32 devstack sudo[91324]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.747s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:32 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:35:33 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:35:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread count: 28 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 11:35:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread info: [<_MainThread(MainThread, started 131707869511808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 11:35:38 devstack sudo[91292]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-24962101-99ae-4a57-8aef-c1a703b5046c" returned: 0 in 7.653s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:38 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Image conversion details: src /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d, size 1024.00 MB, duration 7.65 sec, destination /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-24962101-99ae-4a57-8aef-c1a703b5046c {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 11:35:38 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Converted 1024.00 MB image at 133.77 MB/s Sep 05 11:35:38 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-24962101-99ae-4a57-8aef-c1a703b5046c is being set with open permissions: ugo+rw Sep 05 11:35:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-24962101-99ae-4a57-8aef-c1a703b5046c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:38 devstack sudo[91352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-24962101-99ae-4a57-8aef-c1a703b5046c Sep 05 11:35:38 devstack sudo[91352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:39 devstack sudo[91352]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-24962101-99ae-4a57-8aef-c1a703b5046c" returned: 0 in 0.309s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-quobyte-24962101-99ae-4a57-8aef-c1a703b5046c" released by "_copy_volume_from_snapshot" :: held 8.895s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:35:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-quobyte-bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc-24962101-99ae-4a57-8aef-c1a703b5046c" released by "_create_volume_from_snapshot" :: held 8.974s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:35:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.991s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:35:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5826bf9c-0fb1-416e-97be-37cee7a41de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24962101-99ae-4a57-8aef-c1a703b5046c', 'volume_size': 1, 'snapshot_id': 'bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe672f21-00f0-4789-9d83-eab6fc78cfd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:39 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Volume volume-24962101-99ae-4a57-8aef-c1a703b5046c (24962101-99ae-4a57-8aef-c1a703b5046c): created successfully Sep 05 11:35:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe672f21-00f0-4789-9d83-eab6fc78cfd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Flow 'volume_create_manager' (112d113b-005d-443a-b1ba-e75fb44844c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:35:39 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:35:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] Flow 'volume_create_manager' (5eafe859-548a-45c0-9ebc-4cece64be23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:35:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e86e7a5d-1e68-4acc-a1f3-707213a2044c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:39 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-af18342b-3d20-4f9d-93d5-6411f4a4105f tempest-VolumesDeleteCascade-1514737135 None] Created volume successfully. Sep 05 11:35:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e86e7a5d-1e68-4acc-a1f3-707213a2044c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-588502320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5902952-6699-456e-8918-608a6811bb26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8374c04472439a8f0a15cf8c3a4079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:35:39Z,use_quota=True,user_id='eaf0397856844e479d015d5c72cd6898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bceabdf-9ed4-406b-a8c5-42319937b1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bceabdf-9ed4-406b-a8c5-42319937b1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2938e9f-9361-4cf4-932d-1c15a497db24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2938e9f-9361-4cf4-932d-1c15a497db24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5902952-6699-456e-8918-608a6811bb26', 'volume_name': 'volume-f5902952-6699-456e-8918-608a6811bb26', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26534ed5-b3b5-43eb-b1d3-a669af7c33e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26534ed5-b3b5-43eb-b1d3-a669af7c33e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8954fa5b-293b-4c97-bdc6-2b939461194d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:39 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] Volume f5902952-6699-456e-8918-608a6811bb26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5902952-6699-456e-8918-608a6811bb26', 'volume_size': 1} Sep 05 11:35:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:35:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:35:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-588502320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5902952-6699-456e-8918-608a6811bb26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8374c04472439a8f0a15cf8c3a4079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:35:39Z,use_quota=True,user_id='eaf0397856844e479d015d5c72cd6898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:35:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] Creating volume f5902952-6699-456e-8918-608a6811bb26 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:35:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:35:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:35:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:35:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:35:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:35:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:35:39 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:35:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f5902952-6699-456e-8918-608a6811bb26 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:39 devstack sudo[91355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f5902952-6699-456e-8918-608a6811bb26 1073741824 Sep 05 11:35:39 devstack sudo[91355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:39 devstack sudo[91355]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f5902952-6699-456e-8918-608a6811bb26 1073741824" returned: 0 in 0.498s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Acquiring lock "cinder-21f42cf3-0a60-41b4-aafd-305030d05c7d-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:35:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f5902952-6699-456e-8918-608a6811bb26 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-21f42cf3-0a60-41b4-aafd-305030d05c7d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:35:40 devstack sudo[91362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f5902952-6699-456e-8918-608a6811bb26 Sep 05 11:35:40 devstack sudo[91362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Performing cascade delete. {{(pid=87517) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 05 11:35:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Acquiring lock "cinder-bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:35:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:35:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Acquiring lock "cinder-quobyte-21f42cf3-0a60-41b4-aafd-305030d05c7d" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:35:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-quobyte-21f42cf3-0a60-41b4-aafd-305030d05c7d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:35:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Acquiring lock "cinder-quobyte-bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:35:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-quobyte-bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:35:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Deleting offline snapshot bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc of volume 21f42cf3-0a60-41b4-aafd-305030d05c7d {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:35:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] snapshot_file for this snap is: volume-21f42cf3-0a60-41b4-aafd-305030d05c7d.bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:35:40 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e221ec5a-4719-461d-abb3-f3a9fac3a77f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:35:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d.bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:40 devstack sudo[91362]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f5902952-6699-456e-8918-608a6811bb26" returned: 0 in 0.323s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:35:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:35:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8954fa5b-293b-4c97-bdc6-2b939461194d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5902952-6699-456e-8918-608a6811bb26', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94554c3c-76f8-46b1-89ae-11895c328fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:40 devstack sudo[91364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d.bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc Sep 05 11:35:40 devstack sudo[91364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:40 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] Volume volume-f5902952-6699-456e-8918-608a6811bb26 (f5902952-6699-456e-8918-608a6811bb26): created successfully Sep 05 11:35:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94554c3c-76f8-46b1-89ae-11895c328fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] Flow 'volume_create_manager' (5eafe859-548a-45c0-9ebc-4cece64be23e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:35:40 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-91ed66eb-43a7-4e6b-8f1f-4431ff1f9bb5 tempest-AttachVolumeNegativeTest-57248058 None] Created volume successfully. Sep 05 11:35:40 devstack sudo[91364]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d.bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc" returned: 0 in 0.455s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21f42cf3-0a60-41b4-aafd-305030d05c7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:35:40 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce7d249-6f33-4060-8da0-9b900dac444f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:35:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:40 devstack sudo[91370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d Sep 05 11:35:40 devstack sudo[91370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:41 devstack sudo[91370]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d" returned: 0 in 0.523s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d.bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:41 devstack sudo[91376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d.bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc Sep 05 11:35:41 devstack sudo[91376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:41 devstack sudo[91376]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d.bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc" returned: 0 in 0.388s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d.bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:41 devstack sudo[91385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d.bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc Sep 05 11:35:41 devstack sudo[91385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:41 devstack sudo[91385]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d.bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc" returned: 0 in 0.357s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-quobyte-bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc" released by "_delete_snapshot" :: held 1.832s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:35:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-quobyte-21f42cf3-0a60-41b4-aafd-305030d05c7d" released by "delete_snapshot" :: held 1.862s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:35:42 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Created reservations ['5c3a64c2-f3c6-4667-a826-f34f73b8e85f', '0c67d2e5-3f2e-43ef-9964-fa0cf50beada', '445b5e4c-0fcf-45bd-aec2-0d0117127308', 'bf3e8426-df2f-448e-bf41-2f0ac3de7525'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:35:42 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Delete snapshot completed successfully. Sep 05 11:35:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-bc8c7b9a-d1fa-4571-b19b-5d775b5fb8cc-delete_snapshot" released by "delete_snapshot" :: held 2.091s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:35:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Snapshots deleted, issuing volume delete {{(pid=87517) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 05 11:35:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Acquiring lock "cinder-quobyte-21f42cf3-0a60-41b4-aafd-305030d05c7d" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:35:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-b3864366-c1f9-48e1-91cf-600c0f8a5660 req-2d8f1f94-155e-49e1-b85e-151ac50c1a21 tempest-AttachVolumeNegativeTest-57248058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:35:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-b3864366-c1f9-48e1-91cf-600c0f8a5660 req-2d8f1f94-155e-49e1-b85e-151ac50c1a21 tempest-AttachVolumeNegativeTest-57248058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:35:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-quobyte-21f42cf3-0a60-41b4-aafd-305030d05c7d" acquired by "delete_volume" :: waited 0.045s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:35:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-b3864366-c1f9-48e1-91cf-600c0f8a5660 req-2d8f1f94-155e-49e1-b85e-151ac50c1a21 tempest-AttachVolumeNegativeTest-57248058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.058s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:35:42 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[93535961-2d18-4f6c-8c52-c329a17c2203]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:35:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-b3864366-c1f9-48e1-91cf-600c0f8a5660 req-2d8f1f94-155e-49e1-b85e-151ac50c1a21 tempest-AttachVolumeNegativeTest-57248058 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32', 'name': 'volume-f5902952-6699-456e-8918-608a6811bb26', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '54d10239-17b9-49af-8a84-10b54c92707b', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 11:35:42 devstack sudo[91397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d Sep 05 11:35:42 devstack sudo[91397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:42 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-b3864366-c1f9-48e1-91cf-600c0f8a5660 req-2d8f1f94-155e-49e1-b85e-151ac50c1a21 tempest-AttachVolumeNegativeTest-57248058 None] attachment_update completed successfully. Sep 05 11:35:42 devstack sudo[91397]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d" returned: 0 in 0.457s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:42 devstack sudo[91471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d Sep 05 11:35:42 devstack sudo[91471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:43 devstack sudo[91471]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-21f42cf3-0a60-41b4-aafd-305030d05c7d" returned: 0 in 0.347s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-quobyte-21f42cf3-0a60-41b4-aafd-305030d05c7d" released by "delete_volume" :: held 0.881s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:35:43 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Created reservations ['410a4346-2436-4853-b149-ae8016695159', '759d9612-5f59-4a84-b4a7-88ff004fbf8f', '074b9bec-9299-4e93-98c8-e2d9e106258b', 'a5808a9d-c96b-484b-8b1c-7c9f18e8b3fe'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:35:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:35:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:35:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:35:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:35:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:35:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:43 devstack sudo[91787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:35:43 devstack sudo[91787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c96c6d18-c068-4bad-a1fa-3ba28e114a9c tempest-VolumesDeleteCascade-1514737135 None] Acquiring lock "cinder-24962101-99ae-4a57-8aef-c1a703b5046c-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:35:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c96c6d18-c068-4bad-a1fa-3ba28e114a9c tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-24962101-99ae-4a57-8aef-c1a703b5046c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:35:43 devstack sudo[91787]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c96c6d18-c068-4bad-a1fa-3ba28e114a9c tempest-VolumesDeleteCascade-1514737135 None] Acquiring lock "cinder-quobyte-24962101-99ae-4a57-8aef-c1a703b5046c" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:35:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.470s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:43 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:35:43 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Deleted volume successfully. Sep 05 11:35:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c96c6d18-c068-4bad-a1fa-3ba28e114a9c tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-quobyte-24962101-99ae-4a57-8aef-c1a703b5046c" acquired by "delete_volume" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:35:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-36085ab4-45ad-4d9b-8672-ca464a9d6143 tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-21f42cf3-0a60-41b4-aafd-305030d05c7d-delete_volume" released by "delete_volume" :: held 3.774s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:35:43 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[507ee4ab-2f8a-4beb-8c76-d4d3de119480]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:35:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c96c6d18-c068-4bad-a1fa-3ba28e114a9c tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-24962101-99ae-4a57-8aef-c1a703b5046c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:43 devstack sudo[91790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-24962101-99ae-4a57-8aef-c1a703b5046c Sep 05 11:35:43 devstack sudo[91790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:44 devstack sudo[91790]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c96c6d18-c068-4bad-a1fa-3ba28e114a9c tempest-VolumesDeleteCascade-1514737135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-24962101-99ae-4a57-8aef-c1a703b5046c" returned: 0 in 0.375s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c96c6d18-c068-4bad-a1fa-3ba28e114a9c tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-24962101-99ae-4a57-8aef-c1a703b5046c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:44 devstack sudo[91795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-24962101-99ae-4a57-8aef-c1a703b5046c Sep 05 11:35:44 devstack sudo[91795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:44 devstack sudo[91795]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c96c6d18-c068-4bad-a1fa-3ba28e114a9c tempest-VolumesDeleteCascade-1514737135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-24962101-99ae-4a57-8aef-c1a703b5046c" returned: 0 in 0.261s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c96c6d18-c068-4bad-a1fa-3ba28e114a9c tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-quobyte-24962101-99ae-4a57-8aef-c1a703b5046c" released by "delete_volume" :: held 0.684s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:35:44 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-c96c6d18-c068-4bad-a1fa-3ba28e114a9c tempest-VolumesDeleteCascade-1514737135 None] Created reservations ['c6d3c4c9-9943-45d4-8e8a-9a35fb0723d0', '4c979fac-d6ba-4e9a-b235-d7cc6e251366', '927c228a-1b0a-475e-ab9a-359a06fa4150', 'd5fe04a1-d659-4aa8-aa1c-2fbe5daac03f'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:35:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c96c6d18-c068-4bad-a1fa-3ba28e114a9c tempest-VolumesDeleteCascade-1514737135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:35:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c96c6d18-c068-4bad-a1fa-3ba28e114a9c tempest-VolumesDeleteCascade-1514737135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:35:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c96c6d18-c068-4bad-a1fa-3ba28e114a9c tempest-VolumesDeleteCascade-1514737135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:35:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c96c6d18-c068-4bad-a1fa-3ba28e114a9c tempest-VolumesDeleteCascade-1514737135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:35:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c96c6d18-c068-4bad-a1fa-3ba28e114a9c tempest-VolumesDeleteCascade-1514737135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:35:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c96c6d18-c068-4bad-a1fa-3ba28e114a9c tempest-VolumesDeleteCascade-1514737135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:44 devstack sudo[91798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:35:44 devstack sudo[91798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:44 devstack sudo[91798]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c96c6d18-c068-4bad-a1fa-3ba28e114a9c tempest-VolumesDeleteCascade-1514737135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.343s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:44 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-c96c6d18-c068-4bad-a1fa-3ba28e114a9c tempest-VolumesDeleteCascade-1514737135 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:35:44 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c96c6d18-c068-4bad-a1fa-3ba28e114a9c tempest-VolumesDeleteCascade-1514737135 None] Deleted volume successfully. Sep 05 11:35:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c96c6d18-c068-4bad-a1fa-3ba28e114a9c tempest-VolumesDeleteCascade-1514737135 None] Lock "cinder-24962101-99ae-4a57-8aef-c1a703b5046c-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:35:49 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:35:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] Flow 'volume_create_manager' (dbae9630-9785-47bb-9647-457fe3043b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:35:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9156e332-6d0e-4478-8874-21a87507e9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9156e332-6d0e-4478-8874-21a87507e9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-351385759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce9e2a4-4cc7-4e64-a1a0-fe8a1630a546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d952c8bca91479a9c7c96779be5fddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:35:50Z,use_quota=True,user_id='5d129e40d54e473793c53e08a2244c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce35eca-e335-46b4-8684-2d12b11eac1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce35eca-e335-46b4-8684-2d12b11eac1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcbc1364-ea1b-47d4-bb79-b0ba1fe10b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcbc1364-ea1b-47d4-bb79-b0ba1fe10b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ce9e2a4-4cc7-4e64-a1a0-fe8a1630a546', 'volume_name': 'volume-8ce9e2a4-4cc7-4e64-a1a0-fe8a1630a546', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (333e2011-b206-46ab-a64e-bd366b20960c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (333e2011-b206-46ab-a64e-bd366b20960c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32836d58-99d8-4f55-8f7b-b0c234c63050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:50 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] Volume 8ce9e2a4-4cc7-4e64-a1a0-fe8a1630a546: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ce9e2a4-4cc7-4e64-a1a0-fe8a1630a546', 'volume_size': 1} Sep 05 11:35:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:35:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:35:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-351385759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce9e2a4-4cc7-4e64-a1a0-fe8a1630a546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d952c8bca91479a9c7c96779be5fddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:35:50Z,use_quota=True,user_id='5d129e40d54e473793c53e08a2244c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:35:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] Creating volume 8ce9e2a4-4cc7-4e64-a1a0-fe8a1630a546 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:35:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:35:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:35:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:35:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:35:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:35:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:35:50 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:35:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8ce9e2a4-4cc7-4e64-a1a0-fe8a1630a546 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:50 devstack sudo[91823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8ce9e2a4-4cc7-4e64-a1a0-fe8a1630a546 1073741824 Sep 05 11:35:50 devstack sudo[91823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:50 devstack sudo[91823]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8ce9e2a4-4cc7-4e64-a1a0-fe8a1630a546 1073741824" returned: 0 in 0.833s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8ce9e2a4-4cc7-4e64-a1a0-fe8a1630a546 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:51 devstack sudo[91852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8ce9e2a4-4cc7-4e64-a1a0-fe8a1630a546 Sep 05 11:35:51 devstack sudo[91852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:51 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:35:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] Flow 'volume_create_manager' (e82267a9-26b5-4232-af20-ed6918cb8b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:35:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222b9962-cb2e-4234-b719-9f0338c20ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222b9962-cb2e-4234-b719-9f0338c20ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1212002475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e858e5-983e-4165-8949-c46abca044d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='384dfe3d1a5d4c6f9bd522ae7dda3ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:35:51Z,use_quota=True,user_id='15aa68a8c3bb4e929bcdf7df6ab5618c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf52fa0-4972-4466-8782-225f655c4286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf52fa0-4972-4466-8782-225f655c4286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6defacf5-7efb-49da-acdf-f21d94140949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6defacf5-7efb-49da-acdf-f21d94140949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61e858e5-983e-4165-8949-c46abca044d2', 'volume_name': 'volume-61e858e5-983e-4165-8949-c46abca044d2', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f74029d-be14-4d64-9309-fab81b9bb83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f74029d-be14-4d64-9309-fab81b9bb83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf47dd87-5c8a-4873-8aa9-66ec25395749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:51 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] Volume 61e858e5-983e-4165-8949-c46abca044d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61e858e5-983e-4165-8949-c46abca044d2', 'volume_size': 1} Sep 05 11:35:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:35:51 devstack sudo[91852]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8ce9e2a4-4cc7-4e64-a1a0-fe8a1630a546" returned: 0 in 0.458s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:35:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:35:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.210s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:35:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1212002475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e858e5-983e-4165-8949-c46abca044d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='384dfe3d1a5d4c6f9bd522ae7dda3ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:35:51Z,use_quota=True,user_id='15aa68a8c3bb4e929bcdf7df6ab5618c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:35:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] Creating volume 61e858e5-983e-4165-8949-c46abca044d2 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:35:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:35:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:35:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:35:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:35:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:35:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:35:51 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:35:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32836d58-99d8-4f55-8f7b-b0c234c63050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce9e2a4-4cc7-4e64-a1a0-fe8a1630a546', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e8c9ef2-935a-46fa-9acd-625234b0b636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:51 devstack sudo[91862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2 1073741824 Sep 05 11:35:51 devstack sudo[91862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:51 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] Volume volume-8ce9e2a4-4cc7-4e64-a1a0-fe8a1630a546 (8ce9e2a4-4cc7-4e64-a1a0-fe8a1630a546): created successfully Sep 05 11:35:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e8c9ef2-935a-46fa-9acd-625234b0b636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] Flow 'volume_create_manager' (dbae9630-9785-47bb-9647-457fe3043b58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:35:51 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-be6d3928-defd-4ce3-9e1d-63fc56880085 tempest-AttachVolumeShelveTestJSON-2005213506 None] Created volume successfully. Sep 05 11:35:52 devstack sudo[91862]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2 1073741824" returned: 0 in 0.603s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:52 devstack sudo[91872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2 Sep 05 11:35:52 devstack sudo[91872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:52 devstack sudo[91872]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2" returned: 0 in 0.366s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:52 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:35:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:35:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf47dd87-5c8a-4873-8aa9-66ec25395749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61e858e5-983e-4165-8949-c46abca044d2', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c89b611-ac18-4e05-b3d9-1b84af319438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:35:52 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] Volume volume-61e858e5-983e-4165-8949-c46abca044d2 (61e858e5-983e-4165-8949-c46abca044d2): created successfully Sep 05 11:35:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c89b611-ac18-4e05-b3d9-1b84af319438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:35:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] Flow 'volume_create_manager' (e82267a9-26b5-4232-af20-ed6918cb8b7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:35:52 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-15c4a7af-08ac-4b78-9659-e1dd976d48cc tempest-VolumesSnapshotListTestJSON-1401818247 None] Created volume successfully. Sep 05 11:35:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c83ef268-416a-44de-b7b3-c4f098ee73dd tempest-VolumesSnapshotListTestJSON-1401818247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:35:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c83ef268-416a-44de-b7b3-c4f098ee73dd tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:35:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-c83ef268-416a-44de-b7b3-c4f098ee73dd tempest-VolumesSnapshotListTestJSON-1401818247 None] Creating offline snapshot 1d84b1dc-d58d-4647-8392-61b637f29bd0 of volume 61e858e5-983e-4165-8949-c46abca044d2 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:35:53 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[be86968f-0aa7-40b2-815d-a883a3982156]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:35:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c83ef268-416a-44de-b7b3-c4f098ee73dd tempest-VolumesSnapshotListTestJSON-1401818247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:53 devstack sudo[91897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2 Sep 05 11:35:53 devstack sudo[91897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:54 devstack sudo[91897]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c83ef268-416a-44de-b7b3-c4f098ee73dd tempest-VolumesSnapshotListTestJSON-1401818247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2" returned: 0 in 0.642s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c83ef268-416a-44de-b7b3-c4f098ee73dd tempest-VolumesSnapshotListTestJSON-1401818247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.1d84b1dc-d58d-4647-8392-61b637f29bd0 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:54 devstack sudo[91936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.1d84b1dc-d58d-4647-8392-61b637f29bd0 1G Sep 05 11:35:54 devstack sudo[91936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:55 devstack sudo[91936]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c83ef268-416a-44de-b7b3-c4f098ee73dd tempest-VolumesSnapshotListTestJSON-1401818247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.1d84b1dc-d58d-4647-8392-61b637f29bd0 1G" returned: 0 in 1.206s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c83ef268-416a-44de-b7b3-c4f098ee73dd tempest-VolumesSnapshotListTestJSON-1401818247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61e858e5-983e-4165-8949-c46abca044d2 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.1d84b1dc-d58d-4647-8392-61b637f29bd0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:55 devstack sudo[92004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61e858e5-983e-4165-8949-c46abca044d2 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.1d84b1dc-d58d-4647-8392-61b637f29bd0 Sep 05 11:35:55 devstack sudo[92004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:56 devstack sudo[92004]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c83ef268-416a-44de-b7b3-c4f098ee73dd tempest-VolumesSnapshotListTestJSON-1401818247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61e858e5-983e-4165-8949-c46abca044d2 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.1d84b1dc-d58d-4647-8392-61b637f29bd0" returned: 0 in 0.759s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:56 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-c83ef268-416a-44de-b7b3-c4f098ee73dd tempest-VolumesSnapshotListTestJSON-1401818247 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.1d84b1dc-d58d-4647-8392-61b637f29bd0 is being set with open permissions: ugo+rw Sep 05 11:35:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c83ef268-416a-44de-b7b3-c4f098ee73dd tempest-VolumesSnapshotListTestJSON-1401818247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.1d84b1dc-d58d-4647-8392-61b637f29bd0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:56 devstack sudo[92015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.1d84b1dc-d58d-4647-8392-61b637f29bd0 Sep 05 11:35:56 devstack sudo[92015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:56 devstack sudo[92015]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c83ef268-416a-44de-b7b3-c4f098ee73dd tempest-VolumesSnapshotListTestJSON-1401818247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.1d84b1dc-d58d-4647-8392-61b637f29bd0" returned: 0 in 0.528s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c83ef268-416a-44de-b7b3-c4f098ee73dd tempest-VolumesSnapshotListTestJSON-1401818247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:56 devstack sudo[92019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.info Sep 05 11:35:56 devstack sudo[92019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:57 devstack sudo[92019]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c83ef268-416a-44de-b7b3-c4f098ee73dd tempest-VolumesSnapshotListTestJSON-1401818247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.info" returned: 0 in 0.343s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:57 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-c83ef268-416a-44de-b7b3-c4f098ee73dd tempest-VolumesSnapshotListTestJSON-1401818247 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.info is being set with open permissions: ugo+rw Sep 05 11:35:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c83ef268-416a-44de-b7b3-c4f098ee73dd tempest-VolumesSnapshotListTestJSON-1401818247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:57 devstack sudo[92022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.info Sep 05 11:35:57 devstack sudo[92022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:35:57 devstack sudo[92022]: pam_unix(sudo:session): session closed for user root Sep 05 11:35:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c83ef268-416a-44de-b7b3-c4f098ee73dd tempest-VolumesSnapshotListTestJSON-1401818247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.info" returned: 0 in 0.631s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:35:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c83ef268-416a-44de-b7b3-c4f098ee73dd tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.319s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:35:57 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c83ef268-416a-44de-b7b3-c4f098ee73dd tempest-VolumesSnapshotListTestJSON-1401818247 None] Create snapshot completed successfully Sep 05 11:35:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-285c54e5-7465-421c-a12c-69c885c23a3b tempest-VolumesSnapshotListTestJSON-1401818247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:35:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-285c54e5-7465-421c-a12c-69c885c23a3b tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:35:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-285c54e5-7465-421c-a12c-69c885c23a3b tempest-VolumesSnapshotListTestJSON-1401818247 None] Creating offline snapshot 146a53e1-066a-4f61-a75a-91b9233c587c of volume 61e858e5-983e-4165-8949-c46abca044d2 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:35:59 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ef9497-e58c-4be7-9338-7f50942ebcc3]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:35:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-285c54e5-7465-421c-a12c-69c885c23a3b tempest-VolumesSnapshotListTestJSON-1401818247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.1d84b1dc-d58d-4647-8392-61b637f29bd0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:35:59 devstack sudo[92030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.1d84b1dc-d58d-4647-8392-61b637f29bd0 Sep 05 11:35:59 devstack sudo[92030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:36:00 devstack sudo[92030]: pam_unix(sudo:session): session closed for user root Sep 05 11:36:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-285c54e5-7465-421c-a12c-69c885c23a3b tempest-VolumesSnapshotListTestJSON-1401818247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.1d84b1dc-d58d-4647-8392-61b637f29bd0" returned: 0 in 1.027s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:36:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-285c54e5-7465-421c-a12c-69c885c23a3b tempest-VolumesSnapshotListTestJSON-1401818247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61e858e5-983e-4165-8949-c46abca044d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:36:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-285c54e5-7465-421c-a12c-69c885c23a3b tempest-VolumesSnapshotListTestJSON-1401818247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.1d84b1dc-d58d-4647-8392-61b637f29bd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.146a53e1-066a-4f61-a75a-91b9233c587c 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:36:00 devstack sudo[92037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.1d84b1dc-d58d-4647-8392-61b637f29bd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.146a53e1-066a-4f61-a75a-91b9233c587c 1G Sep 05 11:36:00 devstack sudo[92037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:36:01 devstack sudo[92037]: pam_unix(sudo:session): session closed for user root Sep 05 11:36:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-285c54e5-7465-421c-a12c-69c885c23a3b tempest-VolumesSnapshotListTestJSON-1401818247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.1d84b1dc-d58d-4647-8392-61b637f29bd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.146a53e1-066a-4f61-a75a-91b9233c587c 1G" returned: 0 in 1.088s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:36:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-285c54e5-7465-421c-a12c-69c885c23a3b tempest-VolumesSnapshotListTestJSON-1401818247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61e858e5-983e-4165-8949-c46abca044d2.1d84b1dc-d58d-4647-8392-61b637f29bd0 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.146a53e1-066a-4f61-a75a-91b9233c587c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:36:01 devstack sudo[92046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61e858e5-983e-4165-8949-c46abca044d2.1d84b1dc-d58d-4647-8392-61b637f29bd0 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.146a53e1-066a-4f61-a75a-91b9233c587c Sep 05 11:36:01 devstack sudo[92046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:36:02 devstack sudo[92046]: pam_unix(sudo:session): session closed for user root Sep 05 11:36:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-285c54e5-7465-421c-a12c-69c885c23a3b tempest-VolumesSnapshotListTestJSON-1401818247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61e858e5-983e-4165-8949-c46abca044d2.1d84b1dc-d58d-4647-8392-61b637f29bd0 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.146a53e1-066a-4f61-a75a-91b9233c587c" returned: 0 in 0.604s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:36:02 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-285c54e5-7465-421c-a12c-69c885c23a3b tempest-VolumesSnapshotListTestJSON-1401818247 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.146a53e1-066a-4f61-a75a-91b9233c587c is being set with open permissions: ugo+rw Sep 05 11:36:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-285c54e5-7465-421c-a12c-69c885c23a3b tempest-VolumesSnapshotListTestJSON-1401818247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.146a53e1-066a-4f61-a75a-91b9233c587c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:36:02 devstack sudo[92052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.146a53e1-066a-4f61-a75a-91b9233c587c Sep 05 11:36:02 devstack sudo[92052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:36:02 devstack sudo[92052]: pam_unix(sudo:session): session closed for user root Sep 05 11:36:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-285c54e5-7465-421c-a12c-69c885c23a3b tempest-VolumesSnapshotListTestJSON-1401818247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.146a53e1-066a-4f61-a75a-91b9233c587c" returned: 0 in 0.512s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:36:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-285c54e5-7465-421c-a12c-69c885c23a3b tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.411s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:36:02 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-285c54e5-7465-421c-a12c-69c885c23a3b tempest-VolumesSnapshotListTestJSON-1401818247 None] Create snapshot completed successfully Sep 05 11:36:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-53daae58-400b-416c-9ff9-c6037bacb7c7 tempest-VolumesSnapshotListTestJSON-1401818247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:36:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-53daae58-400b-416c-9ff9-c6037bacb7c7 tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:36:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-53daae58-400b-416c-9ff9-c6037bacb7c7 tempest-VolumesSnapshotListTestJSON-1401818247 None] Creating offline snapshot c58a8e86-31d7-49ef-94bd-1dfd2d9894c4 of volume 61e858e5-983e-4165-8949-c46abca044d2 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:36:04 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5fbcc1-450a-41d9-9515-d396acf1872e]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:36:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-53daae58-400b-416c-9ff9-c6037bacb7c7 tempest-VolumesSnapshotListTestJSON-1401818247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.146a53e1-066a-4f61-a75a-91b9233c587c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:36:04 devstack sudo[92082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.146a53e1-066a-4f61-a75a-91b9233c587c Sep 05 11:36:04 devstack sudo[92082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:36:05 devstack sudo[92082]: pam_unix(sudo:session): session closed for user root Sep 05 11:36:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-53daae58-400b-416c-9ff9-c6037bacb7c7 tempest-VolumesSnapshotListTestJSON-1401818247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.146a53e1-066a-4f61-a75a-91b9233c587c" returned: 0 in 0.883s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:36:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-53daae58-400b-416c-9ff9-c6037bacb7c7 tempest-VolumesSnapshotListTestJSON-1401818247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61e858e5-983e-4165-8949-c46abca044d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:36:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-53daae58-400b-416c-9ff9-c6037bacb7c7 tempest-VolumesSnapshotListTestJSON-1401818247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.146a53e1-066a-4f61-a75a-91b9233c587c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.c58a8e86-31d7-49ef-94bd-1dfd2d9894c4 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:36:05 devstack sudo[92102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.146a53e1-066a-4f61-a75a-91b9233c587c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.c58a8e86-31d7-49ef-94bd-1dfd2d9894c4 1G Sep 05 11:36:05 devstack sudo[92102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:36:06 devstack sudo[92102]: pam_unix(sudo:session): session closed for user root Sep 05 11:36:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-53daae58-400b-416c-9ff9-c6037bacb7c7 tempest-VolumesSnapshotListTestJSON-1401818247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.146a53e1-066a-4f61-a75a-91b9233c587c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.c58a8e86-31d7-49ef-94bd-1dfd2d9894c4 1G" returned: 0 in 0.906s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:36:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-53daae58-400b-416c-9ff9-c6037bacb7c7 tempest-VolumesSnapshotListTestJSON-1401818247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61e858e5-983e-4165-8949-c46abca044d2.146a53e1-066a-4f61-a75a-91b9233c587c -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.c58a8e86-31d7-49ef-94bd-1dfd2d9894c4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:36:06 devstack sudo[92113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61e858e5-983e-4165-8949-c46abca044d2.146a53e1-066a-4f61-a75a-91b9233c587c -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.c58a8e86-31d7-49ef-94bd-1dfd2d9894c4 Sep 05 11:36:06 devstack sudo[92113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:36:06 devstack sudo[92113]: pam_unix(sudo:session): session closed for user root Sep 05 11:36:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-53daae58-400b-416c-9ff9-c6037bacb7c7 tempest-VolumesSnapshotListTestJSON-1401818247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61e858e5-983e-4165-8949-c46abca044d2.146a53e1-066a-4f61-a75a-91b9233c587c -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.c58a8e86-31d7-49ef-94bd-1dfd2d9894c4" returned: 0 in 0.362s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:36:06 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-53daae58-400b-416c-9ff9-c6037bacb7c7 tempest-VolumesSnapshotListTestJSON-1401818247 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.c58a8e86-31d7-49ef-94bd-1dfd2d9894c4 is being set with open permissions: ugo+rw Sep 05 11:36:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-53daae58-400b-416c-9ff9-c6037bacb7c7 tempest-VolumesSnapshotListTestJSON-1401818247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.c58a8e86-31d7-49ef-94bd-1dfd2d9894c4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:36:06 devstack sudo[92118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.c58a8e86-31d7-49ef-94bd-1dfd2d9894c4 Sep 05 11:36:06 devstack sudo[92118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:36:06 devstack sudo[92118]: pam_unix(sudo:session): session closed for user root Sep 05 11:36:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-53daae58-400b-416c-9ff9-c6037bacb7c7 tempest-VolumesSnapshotListTestJSON-1401818247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.c58a8e86-31d7-49ef-94bd-1dfd2d9894c4" returned: 0 in 0.293s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:36:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-53daae58-400b-416c-9ff9-c6037bacb7c7 tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.604s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:36:06 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-53daae58-400b-416c-9ff9-c6037bacb7c7 tempest-VolumesSnapshotListTestJSON-1401818247 None] Create snapshot completed successfully Sep 05 11:36:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-c59a575d-aab7-43d1-8ae4-fb16f0c9e80f req-5174b74e-5e8f-43e6-80e1-895c9b812b7d tempest-AttachVolumeShelveTestJSON-2005213506 None] No connector for attachment 2a1752dd-cef9-4051-b227-e2f1aa74ebe1; skipping storage backend terminate_connection call. {{(pid=87517) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 05 11:36:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-c59a575d-aab7-43d1-8ae4-fb16f0c9e80f req-5174b74e-5e8f-43e6-80e1-895c9b812b7d tempest-AttachVolumeShelveTestJSON-2005213506 None] Deleting attachment 2a1752dd-cef9-4051-b227-e2f1aa74ebe1. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 11:36:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-aa1d2b77-3d73-4377-ad0e-52f40eb02534 tempest-VolumesSnapshotListTestJSON-1401818247 None] Acquiring lock "cinder-c58a8e86-31d7-49ef-94bd-1dfd2d9894c4-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:36:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-aa1d2b77-3d73-4377-ad0e-52f40eb02534 tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "cinder-c58a8e86-31d7-49ef-94bd-1dfd2d9894c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:36:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-aa1d2b77-3d73-4377-ad0e-52f40eb02534 tempest-VolumesSnapshotListTestJSON-1401818247 None] Acquiring lock "cinder-quobyte-61e858e5-983e-4165-8949-c46abca044d2" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:36:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-aa1d2b77-3d73-4377-ad0e-52f40eb02534 tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "cinder-quobyte-61e858e5-983e-4165-8949-c46abca044d2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:36:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-aa1d2b77-3d73-4377-ad0e-52f40eb02534 tempest-VolumesSnapshotListTestJSON-1401818247 None] Acquiring lock "cinder-quobyte-c58a8e86-31d7-49ef-94bd-1dfd2d9894c4" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:36:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-aa1d2b77-3d73-4377-ad0e-52f40eb02534 tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "cinder-quobyte-c58a8e86-31d7-49ef-94bd-1dfd2d9894c4" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:36:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-aa1d2b77-3d73-4377-ad0e-52f40eb02534 tempest-VolumesSnapshotListTestJSON-1401818247 None] Deleting offline snapshot c58a8e86-31d7-49ef-94bd-1dfd2d9894c4 of volume 61e858e5-983e-4165-8949-c46abca044d2 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:36:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-aa1d2b77-3d73-4377-ad0e-52f40eb02534 tempest-VolumesSnapshotListTestJSON-1401818247 None] snapshot_file for this snap is: volume-61e858e5-983e-4165-8949-c46abca044d2.c58a8e86-31d7-49ef-94bd-1dfd2d9894c4 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:36:08 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48b0189-3d26-4b5b-9eb0-2a3da0f5799a]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:36:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aa1d2b77-3d73-4377-ad0e-52f40eb02534 tempest-VolumesSnapshotListTestJSON-1401818247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.c58a8e86-31d7-49ef-94bd-1dfd2d9894c4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:36:08 devstack sudo[92124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.c58a8e86-31d7-49ef-94bd-1dfd2d9894c4 Sep 05 11:36:08 devstack sudo[92124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:36:09 devstack sudo[92124]: pam_unix(sudo:session): session closed for user root Sep 05 11:36:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aa1d2b77-3d73-4377-ad0e-52f40eb02534 tempest-VolumesSnapshotListTestJSON-1401818247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.c58a8e86-31d7-49ef-94bd-1dfd2d9894c4" returned: 0 in 0.457s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:36:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-aa1d2b77-3d73-4377-ad0e-52f40eb02534 tempest-VolumesSnapshotListTestJSON-1401818247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61e858e5-983e-4165-8949-c46abca044d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:36:09 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[be226953-2b33-46f3-8711-fc895c2dde5c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:36:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aa1d2b77-3d73-4377-ad0e-52f40eb02534 tempest-VolumesSnapshotListTestJSON-1401818247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.146a53e1-066a-4f61-a75a-91b9233c587c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:36:09 devstack sudo[92129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.146a53e1-066a-4f61-a75a-91b9233c587c Sep 05 11:36:09 devstack sudo[92129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:36:09 devstack sudo[92129]: pam_unix(sudo:session): session closed for user root Sep 05 11:36:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aa1d2b77-3d73-4377-ad0e-52f40eb02534 tempest-VolumesSnapshotListTestJSON-1401818247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.146a53e1-066a-4f61-a75a-91b9233c587c" returned: 0 in 0.628s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:36:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-aa1d2b77-3d73-4377-ad0e-52f40eb02534 tempest-VolumesSnapshotListTestJSON-1401818247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61e858e5-983e-4165-8949-c46abca044d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:36:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aa1d2b77-3d73-4377-ad0e-52f40eb02534 tempest-VolumesSnapshotListTestJSON-1401818247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.c58a8e86-31d7-49ef-94bd-1dfd2d9894c4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:36:10 devstack sudo[92135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.c58a8e86-31d7-49ef-94bd-1dfd2d9894c4 Sep 05 11:36:10 devstack sudo[92135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:36:10 devstack sudo[92135]: pam_unix(sudo:session): session closed for user root Sep 05 11:36:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aa1d2b77-3d73-4377-ad0e-52f40eb02534 tempest-VolumesSnapshotListTestJSON-1401818247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.c58a8e86-31d7-49ef-94bd-1dfd2d9894c4" returned: 0 in 0.558s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:36:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aa1d2b77-3d73-4377-ad0e-52f40eb02534 tempest-VolumesSnapshotListTestJSON-1401818247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.c58a8e86-31d7-49ef-94bd-1dfd2d9894c4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:36:10 devstack sudo[92181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.c58a8e86-31d7-49ef-94bd-1dfd2d9894c4 Sep 05 11:36:10 devstack sudo[92181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:36:10 devstack sudo[92181]: pam_unix(sudo:session): session closed for user root Sep 05 11:36:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aa1d2b77-3d73-4377-ad0e-52f40eb02534 tempest-VolumesSnapshotListTestJSON-1401818247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.c58a8e86-31d7-49ef-94bd-1dfd2d9894c4" returned: 0 in 0.287s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:36:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-aa1d2b77-3d73-4377-ad0e-52f40eb02534 tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "cinder-quobyte-c58a8e86-31d7-49ef-94bd-1dfd2d9894c4" released by "_delete_snapshot" :: held 2.122s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:36:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-aa1d2b77-3d73-4377-ad0e-52f40eb02534 tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "cinder-quobyte-61e858e5-983e-4165-8949-c46abca044d2" released by "delete_snapshot" :: held 2.171s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:36:11 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-aa1d2b77-3d73-4377-ad0e-52f40eb02534 tempest-VolumesSnapshotListTestJSON-1401818247 None] Created reservations ['337194e7-1a4c-42bc-9402-e9d398f7a8fa', '195e1057-65c6-4eb3-9a26-ccf6c15c8b85', '8929ce4e-618d-4b33-a5af-a799293bb8ba', 'c3a5059f-911e-48ad-a97d-6b0cdd4834ff'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:36:11 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-aa1d2b77-3d73-4377-ad0e-52f40eb02534 tempest-VolumesSnapshotListTestJSON-1401818247 None] Delete snapshot completed successfully. Sep 05 11:36:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-aa1d2b77-3d73-4377-ad0e-52f40eb02534 tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "cinder-c58a8e86-31d7-49ef-94bd-1dfd2d9894c4-delete_snapshot" released by "delete_snapshot" :: held 2.392s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:36:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f35f3440-ea6a-405b-930a-38abba08339a tempest-VolumesSnapshotListTestJSON-1401818247 None] Acquiring lock "cinder-146a53e1-066a-4f61-a75a-91b9233c587c-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:36:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f35f3440-ea6a-405b-930a-38abba08339a tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "cinder-146a53e1-066a-4f61-a75a-91b9233c587c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:36:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f35f3440-ea6a-405b-930a-38abba08339a tempest-VolumesSnapshotListTestJSON-1401818247 None] Acquiring lock "cinder-quobyte-61e858e5-983e-4165-8949-c46abca044d2" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:36:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f35f3440-ea6a-405b-930a-38abba08339a tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "cinder-quobyte-61e858e5-983e-4165-8949-c46abca044d2" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:36:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f35f3440-ea6a-405b-930a-38abba08339a tempest-VolumesSnapshotListTestJSON-1401818247 None] Acquiring lock "cinder-quobyte-146a53e1-066a-4f61-a75a-91b9233c587c" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:36:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f35f3440-ea6a-405b-930a-38abba08339a tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "cinder-quobyte-146a53e1-066a-4f61-a75a-91b9233c587c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:36:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-f35f3440-ea6a-405b-930a-38abba08339a tempest-VolumesSnapshotListTestJSON-1401818247 None] Deleting offline snapshot 146a53e1-066a-4f61-a75a-91b9233c587c of volume 61e858e5-983e-4165-8949-c46abca044d2 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:36:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-f35f3440-ea6a-405b-930a-38abba08339a tempest-VolumesSnapshotListTestJSON-1401818247 None] snapshot_file for this snap is: volume-61e858e5-983e-4165-8949-c46abca044d2.146a53e1-066a-4f61-a75a-91b9233c587c {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:36:12 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e3064e-6139-418a-ac65-4560936bf119]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:36:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f35f3440-ea6a-405b-930a-38abba08339a tempest-VolumesSnapshotListTestJSON-1401818247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.146a53e1-066a-4f61-a75a-91b9233c587c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:36:12 devstack sudo[92203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.146a53e1-066a-4f61-a75a-91b9233c587c Sep 05 11:36:12 devstack sudo[92203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:36:12 devstack sudo[92203]: pam_unix(sudo:session): session closed for user root Sep 05 11:36:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f35f3440-ea6a-405b-930a-38abba08339a tempest-VolumesSnapshotListTestJSON-1401818247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.146a53e1-066a-4f61-a75a-91b9233c587c" returned: 0 in 0.574s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:36:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-f35f3440-ea6a-405b-930a-38abba08339a tempest-VolumesSnapshotListTestJSON-1401818247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61e858e5-983e-4165-8949-c46abca044d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:36:12 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[152f12ba-fbf0-48a1-928d-7e7226cf598c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:36:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f35f3440-ea6a-405b-930a-38abba08339a tempest-VolumesSnapshotListTestJSON-1401818247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.1d84b1dc-d58d-4647-8392-61b637f29bd0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:36:12 devstack sudo[92208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.1d84b1dc-d58d-4647-8392-61b637f29bd0 Sep 05 11:36:12 devstack sudo[92208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:36:13 devstack sudo[92208]: pam_unix(sudo:session): session closed for user root Sep 05 11:36:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f35f3440-ea6a-405b-930a-38abba08339a tempest-VolumesSnapshotListTestJSON-1401818247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.1d84b1dc-d58d-4647-8392-61b637f29bd0" returned: 0 in 0.513s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:36:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-f35f3440-ea6a-405b-930a-38abba08339a tempest-VolumesSnapshotListTestJSON-1401818247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61e858e5-983e-4165-8949-c46abca044d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:36:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f35f3440-ea6a-405b-930a-38abba08339a tempest-VolumesSnapshotListTestJSON-1401818247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.146a53e1-066a-4f61-a75a-91b9233c587c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:36:13 devstack sudo[92213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.146a53e1-066a-4f61-a75a-91b9233c587c Sep 05 11:36:13 devstack sudo[92213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:36:13 devstack sudo[92213]: pam_unix(sudo:session): session closed for user root Sep 05 11:36:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f35f3440-ea6a-405b-930a-38abba08339a tempest-VolumesSnapshotListTestJSON-1401818247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.146a53e1-066a-4f61-a75a-91b9233c587c" returned: 0 in 0.435s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:36:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f35f3440-ea6a-405b-930a-38abba08339a tempest-VolumesSnapshotListTestJSON-1401818247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.146a53e1-066a-4f61-a75a-91b9233c587c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:36:13 devstack sudo[92220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.146a53e1-066a-4f61-a75a-91b9233c587c Sep 05 11:36:13 devstack sudo[92220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:36:13 devstack sudo[92220]: pam_unix(sudo:session): session closed for user root Sep 05 11:36:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f35f3440-ea6a-405b-930a-38abba08339a tempest-VolumesSnapshotListTestJSON-1401818247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.146a53e1-066a-4f61-a75a-91b9233c587c" returned: 0 in 0.282s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:36:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f35f3440-ea6a-405b-930a-38abba08339a tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "cinder-quobyte-146a53e1-066a-4f61-a75a-91b9233c587c" released by "_delete_snapshot" :: held 1.952s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:36:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f35f3440-ea6a-405b-930a-38abba08339a tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "cinder-quobyte-61e858e5-983e-4165-8949-c46abca044d2" released by "delete_snapshot" :: held 1.984s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:36:14 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-f35f3440-ea6a-405b-930a-38abba08339a tempest-VolumesSnapshotListTestJSON-1401818247 None] Created reservations ['09582459-67fe-4441-8238-0a28223b716e', '85777a65-1ef6-48d5-bce4-146ea67025fd', 'b0902b47-fc26-47e8-87d8-6d37d43d9241', '17fcef36-4459-4a20-8d4d-bbe2d86a440c'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:36:14 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f35f3440-ea6a-405b-930a-38abba08339a tempest-VolumesSnapshotListTestJSON-1401818247 None] Delete snapshot completed successfully. Sep 05 11:36:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f35f3440-ea6a-405b-930a-38abba08339a tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "cinder-146a53e1-066a-4f61-a75a-91b9233c587c-delete_snapshot" released by "delete_snapshot" :: held 2.174s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:36:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c3894dda-418f-42dd-ab80-8dd00a9113fa tempest-VolumesSnapshotListTestJSON-1401818247 None] Acquiring lock "cinder-1d84b1dc-d58d-4647-8392-61b637f29bd0-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:36:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c3894dda-418f-42dd-ab80-8dd00a9113fa tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "cinder-1d84b1dc-d58d-4647-8392-61b637f29bd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:36:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c3894dda-418f-42dd-ab80-8dd00a9113fa tempest-VolumesSnapshotListTestJSON-1401818247 None] Acquiring lock "cinder-quobyte-61e858e5-983e-4165-8949-c46abca044d2" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:36:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c3894dda-418f-42dd-ab80-8dd00a9113fa tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "cinder-quobyte-61e858e5-983e-4165-8949-c46abca044d2" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:36:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c3894dda-418f-42dd-ab80-8dd00a9113fa tempest-VolumesSnapshotListTestJSON-1401818247 None] Acquiring lock "cinder-quobyte-1d84b1dc-d58d-4647-8392-61b637f29bd0" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:36:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c3894dda-418f-42dd-ab80-8dd00a9113fa tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "cinder-quobyte-1d84b1dc-d58d-4647-8392-61b637f29bd0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:36:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-c3894dda-418f-42dd-ab80-8dd00a9113fa tempest-VolumesSnapshotListTestJSON-1401818247 None] Deleting offline snapshot 1d84b1dc-d58d-4647-8392-61b637f29bd0 of volume 61e858e5-983e-4165-8949-c46abca044d2 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:36:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-c3894dda-418f-42dd-ab80-8dd00a9113fa tempest-VolumesSnapshotListTestJSON-1401818247 None] snapshot_file for this snap is: volume-61e858e5-983e-4165-8949-c46abca044d2.1d84b1dc-d58d-4647-8392-61b637f29bd0 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:36:15 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[6661e1e1-d504-47c6-86bf-2de246b634cf]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:36:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3894dda-418f-42dd-ab80-8dd00a9113fa tempest-VolumesSnapshotListTestJSON-1401818247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.1d84b1dc-d58d-4647-8392-61b637f29bd0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:36:15 devstack sudo[92255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.1d84b1dc-d58d-4647-8392-61b637f29bd0 Sep 05 11:36:15 devstack sudo[92255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:36:15 devstack sudo[92255]: pam_unix(sudo:session): session closed for user root Sep 05 11:36:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3894dda-418f-42dd-ab80-8dd00a9113fa tempest-VolumesSnapshotListTestJSON-1401818247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.1d84b1dc-d58d-4647-8392-61b637f29bd0" returned: 0 in 0.395s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:36:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-c3894dda-418f-42dd-ab80-8dd00a9113fa tempest-VolumesSnapshotListTestJSON-1401818247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61e858e5-983e-4165-8949-c46abca044d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:36:15 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[99048bb5-91f7-4280-b223-c1d3cfaa601f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:36:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3894dda-418f-42dd-ab80-8dd00a9113fa tempest-VolumesSnapshotListTestJSON-1401818247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:36:15 devstack sudo[92260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2 Sep 05 11:36:15 devstack sudo[92260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:36:16 devstack sudo[92260]: pam_unix(sudo:session): session closed for user root Sep 05 11:36:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3894dda-418f-42dd-ab80-8dd00a9113fa tempest-VolumesSnapshotListTestJSON-1401818247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2" returned: 0 in 0.369s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:36:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3894dda-418f-42dd-ab80-8dd00a9113fa tempest-VolumesSnapshotListTestJSON-1401818247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.1d84b1dc-d58d-4647-8392-61b637f29bd0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:36:16 devstack sudo[92265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.1d84b1dc-d58d-4647-8392-61b637f29bd0 Sep 05 11:36:16 devstack sudo[92265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:36:16 devstack sudo[92265]: pam_unix(sudo:session): session closed for user root Sep 05 11:36:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3894dda-418f-42dd-ab80-8dd00a9113fa tempest-VolumesSnapshotListTestJSON-1401818247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.1d84b1dc-d58d-4647-8392-61b637f29bd0" returned: 0 in 0.361s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:36:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3894dda-418f-42dd-ab80-8dd00a9113fa tempest-VolumesSnapshotListTestJSON-1401818247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.1d84b1dc-d58d-4647-8392-61b637f29bd0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:36:16 devstack sudo[92271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.1d84b1dc-d58d-4647-8392-61b637f29bd0 Sep 05 11:36:16 devstack sudo[92271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:36:16 devstack sudo[92271]: pam_unix(sudo:session): session closed for user root Sep 05 11:36:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3894dda-418f-42dd-ab80-8dd00a9113fa tempest-VolumesSnapshotListTestJSON-1401818247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2.1d84b1dc-d58d-4647-8392-61b637f29bd0" returned: 0 in 0.363s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:36:16 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=69,cinder:INSERT=18,cinder:UPDATE=81,cinder:DELETE=7 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:36:16 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=70,cinder:INSERT=21,cinder:UPDATE=65,cinder:DELETE=5 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:36:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c3894dda-418f-42dd-ab80-8dd00a9113fa tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "cinder-quobyte-1d84b1dc-d58d-4647-8392-61b637f29bd0" released by "_delete_snapshot" :: held 1.636s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:36:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c3894dda-418f-42dd-ab80-8dd00a9113fa tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "cinder-quobyte-61e858e5-983e-4165-8949-c46abca044d2" released by "delete_snapshot" :: held 1.667s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:36:17 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-c3894dda-418f-42dd-ab80-8dd00a9113fa tempest-VolumesSnapshotListTestJSON-1401818247 None] Created reservations ['38468252-0d2f-460b-b136-762358fc5764', '1b86d100-d156-489e-8d73-0ef4aa336b3f', 'c0cbfc7d-8aef-4912-8b58-1cf1ce40793d', '51b2e5a8-fc69-468f-a830-59f5b5e8b915'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:36:17 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c3894dda-418f-42dd-ab80-8dd00a9113fa tempest-VolumesSnapshotListTestJSON-1401818247 None] Delete snapshot completed successfully. Sep 05 11:36:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c3894dda-418f-42dd-ab80-8dd00a9113fa tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "cinder-1d84b1dc-d58d-4647-8392-61b637f29bd0-delete_snapshot" released by "delete_snapshot" :: held 1.845s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:36:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a5b8a771-2a33-417b-beed-af1ccddb47f0 tempest-VolumesSnapshotListTestJSON-1401818247 None] Acquiring lock "cinder-61e858e5-983e-4165-8949-c46abca044d2-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:36:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a5b8a771-2a33-417b-beed-af1ccddb47f0 tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "cinder-61e858e5-983e-4165-8949-c46abca044d2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:36:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a5b8a771-2a33-417b-beed-af1ccddb47f0 tempest-VolumesSnapshotListTestJSON-1401818247 None] Acquiring lock "cinder-quobyte-61e858e5-983e-4165-8949-c46abca044d2" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:36:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a5b8a771-2a33-417b-beed-af1ccddb47f0 tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "cinder-quobyte-61e858e5-983e-4165-8949-c46abca044d2" acquired by "delete_volume" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:36:17 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[43384ba0-5aff-4c0d-87d9-5e103c987640]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:36:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a5b8a771-2a33-417b-beed-af1ccddb47f0 tempest-VolumesSnapshotListTestJSON-1401818247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:36:17 devstack sudo[92341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2 Sep 05 11:36:17 devstack sudo[92341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:36:18 devstack sudo[92341]: pam_unix(sudo:session): session closed for user root Sep 05 11:36:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a5b8a771-2a33-417b-beed-af1ccddb47f0 tempest-VolumesSnapshotListTestJSON-1401818247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2" returned: 0 in 0.546s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:36:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a5b8a771-2a33-417b-beed-af1ccddb47f0 tempest-VolumesSnapshotListTestJSON-1401818247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:36:18 devstack sudo[92348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2 Sep 05 11:36:18 devstack sudo[92348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:36:18 devstack sudo[92348]: pam_unix(sudo:session): session closed for user root Sep 05 11:36:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a5b8a771-2a33-417b-beed-af1ccddb47f0 tempest-VolumesSnapshotListTestJSON-1401818247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-61e858e5-983e-4165-8949-c46abca044d2" returned: 0 in 0.347s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:36:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a5b8a771-2a33-417b-beed-af1ccddb47f0 tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "cinder-quobyte-61e858e5-983e-4165-8949-c46abca044d2" released by "delete_volume" :: held 0.969s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:36:18 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-a5b8a771-2a33-417b-beed-af1ccddb47f0 tempest-VolumesSnapshotListTestJSON-1401818247 None] Created reservations ['df5fcd12-b7fe-4b7e-bc7d-b5c2cde35e88', 'f5706f2b-d017-47b1-bfc6-db6b1af81ec8', 'b866ceb6-09c1-4cbd-b03a-24b6366bd313', '7d234dce-f2ad-4ec5-9321-8819b0a0026d'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:36:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a5b8a771-2a33-417b-beed-af1ccddb47f0 tempest-VolumesSnapshotListTestJSON-1401818247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:36:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a5b8a771-2a33-417b-beed-af1ccddb47f0 tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:36:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a5b8a771-2a33-417b-beed-af1ccddb47f0 tempest-VolumesSnapshotListTestJSON-1401818247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:36:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a5b8a771-2a33-417b-beed-af1ccddb47f0 tempest-VolumesSnapshotListTestJSON-1401818247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:36:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a5b8a771-2a33-417b-beed-af1ccddb47f0 tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:36:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a5b8a771-2a33-417b-beed-af1ccddb47f0 tempest-VolumesSnapshotListTestJSON-1401818247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:36:18 devstack sudo[92352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:36:18 devstack sudo[92352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:36:19 devstack sudo[92352]: pam_unix(sudo:session): session closed for user root Sep 05 11:36:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a5b8a771-2a33-417b-beed-af1ccddb47f0 tempest-VolumesSnapshotListTestJSON-1401818247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.414s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:36:19 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-a5b8a771-2a33-417b-beed-af1ccddb47f0 tempest-VolumesSnapshotListTestJSON-1401818247 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:36:19 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a5b8a771-2a33-417b-beed-af1ccddb47f0 tempest-VolumesSnapshotListTestJSON-1401818247 None] Deleted volume successfully. Sep 05 11:36:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a5b8a771-2a33-417b-beed-af1ccddb47f0 tempest-VolumesSnapshotListTestJSON-1401818247 None] Lock "cinder-61e858e5-983e-4165-8949-c46abca044d2-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:36:23 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:36:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] Flow 'volume_create_manager' (c968dae8-d6d1-4e7b-b293-03d772c73d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:36:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb21002b-bdef-4f6c-80f0-f26b40aee443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:36:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb21002b-bdef-4f6c-80f0-f26b40aee443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1621010362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=316b4a8e-57e9-44a1-be4f-c7ff249279c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a58c22f50ee3475586aa7c1adc7bb46d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:36:23Z,use_quota=True,user_id='23146f486fb248ad8401941c71fa972f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:36:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d95b7eec-9b74-4f13-87ed-44d2719510f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:36:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d95b7eec-9b74-4f13-87ed-44d2719510f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:36:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a2a16b8-8cc7-4537-a51f-44cdfaf805cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:36:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a2a16b8-8cc7-4537-a51f-44cdfaf805cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '316b4a8e-57e9-44a1-be4f-c7ff249279c4', 'volume_name': 'volume-316b4a8e-57e9-44a1-be4f-c7ff249279c4', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:36:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81ac7fd-cdd8-4fbd-bf30-86af364a229e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:36:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81ac7fd-cdd8-4fbd-bf30-86af364a229e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:36:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f3163bf-f7fe-4357-abe6-9b91514d28dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:36:23 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] Volume 316b4a8e-57e9-44a1-be4f-c7ff249279c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-316b4a8e-57e9-44a1-be4f-c7ff249279c4', 'volume_size': 1} Sep 05 11:36:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:36:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:36:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1621010362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=316b4a8e-57e9-44a1-be4f-c7ff249279c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a58c22f50ee3475586aa7c1adc7bb46d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:36:23Z,use_quota=True,user_id='23146f486fb248ad8401941c71fa972f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:36:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] Creating volume 316b4a8e-57e9-44a1-be4f-c7ff249279c4 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:36:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:36:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:36:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:36:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:36:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:36:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:36:23 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:36:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-316b4a8e-57e9-44a1-be4f-c7ff249279c4 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:36:23 devstack sudo[92390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-316b4a8e-57e9-44a1-be4f-c7ff249279c4 1073741824 Sep 05 11:36:23 devstack sudo[92390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:36:24 devstack sudo[92390]: pam_unix(sudo:session): session closed for user root Sep 05 11:36:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-316b4a8e-57e9-44a1-be4f-c7ff249279c4 1073741824" returned: 0 in 0.879s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:36:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-316b4a8e-57e9-44a1-be4f-c7ff249279c4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:36:24 devstack sudo[92400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-316b4a8e-57e9-44a1-be4f-c7ff249279c4 Sep 05 11:36:24 devstack sudo[92400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:36:24 devstack sudo[92400]: pam_unix(sudo:session): session closed for user root Sep 05 11:36:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-316b4a8e-57e9-44a1-be4f-c7ff249279c4" returned: 0 in 0.638s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:36:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:36:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:36:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f3163bf-f7fe-4357-abe6-9b91514d28dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-316b4a8e-57e9-44a1-be4f-c7ff249279c4', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:36:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fafac1c9-f1b0-4a28-a96e-22aa8a073a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:36:25 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] Volume volume-316b4a8e-57e9-44a1-be4f-c7ff249279c4 (316b4a8e-57e9-44a1-be4f-c7ff249279c4): created successfully Sep 05 11:36:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fafac1c9-f1b0-4a28-a96e-22aa8a073a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:36:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] Flow 'volume_create_manager' (c968dae8-d6d1-4e7b-b293-03d772c73d17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:36:25 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-86ba3aff-5494-4a50-9d09-5d815e564029 tempest-ServerActionsTestOtherA-1878425266 None] Created volume successfully. Sep 05 11:36:29 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-ecf2f39c-b6b4-4138-b68e-cc11964cdae7 req-ce7e82b5-f789-460f-89d2-b9b4ca089a79 tempest-AttachVolumeNegativeTest-57248058 None] Terminate volume connection completed successfully. Sep 05 11:36:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-ecf2f39c-b6b4-4138-b68e-cc11964cdae7 req-ce7e82b5-f789-460f-89d2-b9b4ca089a79 tempest-AttachVolumeNegativeTest-57248058 None] Deleting attachment 54d10239-17b9-49af-8a84-10b54c92707b. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 11:36:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:36:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:36:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:36:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:36:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:36:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:36:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:36:32 devstack sudo[92528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:36:32 devstack sudo[92528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:36:32 devstack sudo[92528]: pam_unix(sudo:session): session closed for user root Sep 05 11:36:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.331s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:36:32 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:36:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:36:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread count: 28 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 11:36:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread info: [<_MainThread(MainThread, started 131707869511808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 11:36:35 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=12,cinder:INSERT=4,cinder:UPDATE=18,cinder:DELETE=1 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:36:39 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=13,cinder:INSERT=5,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:36:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3020b2c1-ab2f-41ba-998c-7c43f6cea236 tempest-AttachVolumeShelveTestJSON-2005213506 None] Acquiring lock "cinder-8ce9e2a4-4cc7-4e64-a1a0-fe8a1630a546-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:36:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3020b2c1-ab2f-41ba-998c-7c43f6cea236 tempest-AttachVolumeShelveTestJSON-2005213506 None] Lock "cinder-8ce9e2a4-4cc7-4e64-a1a0-fe8a1630a546-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:36:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3020b2c1-ab2f-41ba-998c-7c43f6cea236 tempest-AttachVolumeShelveTestJSON-2005213506 None] Acquiring lock "cinder-quobyte-8ce9e2a4-4cc7-4e64-a1a0-fe8a1630a546" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:36:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3020b2c1-ab2f-41ba-998c-7c43f6cea236 tempest-AttachVolumeShelveTestJSON-2005213506 None] Lock "cinder-quobyte-8ce9e2a4-4cc7-4e64-a1a0-fe8a1630a546" acquired by "delete_volume" :: waited 0.037s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:36:48 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[78948855-bd1b-4fcc-8b3e-e40d018cbee6]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:36:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3020b2c1-ab2f-41ba-998c-7c43f6cea236 tempest-AttachVolumeShelveTestJSON-2005213506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8ce9e2a4-4cc7-4e64-a1a0-fe8a1630a546 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:36:48 devstack sudo[92619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8ce9e2a4-4cc7-4e64-a1a0-fe8a1630a546 Sep 05 11:36:48 devstack sudo[92619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:36:49 devstack sudo[92619]: pam_unix(sudo:session): session closed for user root Sep 05 11:36:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3020b2c1-ab2f-41ba-998c-7c43f6cea236 tempest-AttachVolumeShelveTestJSON-2005213506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8ce9e2a4-4cc7-4e64-a1a0-fe8a1630a546" returned: 0 in 0.751s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:36:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3020b2c1-ab2f-41ba-998c-7c43f6cea236 tempest-AttachVolumeShelveTestJSON-2005213506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8ce9e2a4-4cc7-4e64-a1a0-fe8a1630a546 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:36:49 devstack sudo[92635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8ce9e2a4-4cc7-4e64-a1a0-fe8a1630a546 Sep 05 11:36:49 devstack sudo[92635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:36:49 devstack sudo[92635]: pam_unix(sudo:session): session closed for user root Sep 05 11:36:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3020b2c1-ab2f-41ba-998c-7c43f6cea236 tempest-AttachVolumeShelveTestJSON-2005213506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8ce9e2a4-4cc7-4e64-a1a0-fe8a1630a546" returned: 0 in 0.339s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:36:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3020b2c1-ab2f-41ba-998c-7c43f6cea236 tempest-AttachVolumeShelveTestJSON-2005213506 None] Lock "cinder-quobyte-8ce9e2a4-4cc7-4e64-a1a0-fe8a1630a546" released by "delete_volume" :: held 1.175s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:36:49 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-3020b2c1-ab2f-41ba-998c-7c43f6cea236 tempest-AttachVolumeShelveTestJSON-2005213506 None] Created reservations ['5594bfac-769b-444f-a845-15a3af86af73', '6ee2c161-af02-4894-9027-2f797551210d', '5de29677-b90c-4243-b8cb-a6c4c29a6bb7', 'cb6d3744-4eca-4fee-a752-edde7981baf5'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:36:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3020b2c1-ab2f-41ba-998c-7c43f6cea236 tempest-AttachVolumeShelveTestJSON-2005213506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:36:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3020b2c1-ab2f-41ba-998c-7c43f6cea236 tempest-AttachVolumeShelveTestJSON-2005213506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:36:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3020b2c1-ab2f-41ba-998c-7c43f6cea236 tempest-AttachVolumeShelveTestJSON-2005213506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:36:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3020b2c1-ab2f-41ba-998c-7c43f6cea236 tempest-AttachVolumeShelveTestJSON-2005213506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:36:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3020b2c1-ab2f-41ba-998c-7c43f6cea236 tempest-AttachVolumeShelveTestJSON-2005213506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:36:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3020b2c1-ab2f-41ba-998c-7c43f6cea236 tempest-AttachVolumeShelveTestJSON-2005213506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:36:49 devstack sudo[92640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:36:49 devstack sudo[92640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:36:50 devstack sudo[92640]: pam_unix(sudo:session): session closed for user root Sep 05 11:36:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3020b2c1-ab2f-41ba-998c-7c43f6cea236 tempest-AttachVolumeShelveTestJSON-2005213506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.394s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:36:50 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-3020b2c1-ab2f-41ba-998c-7c43f6cea236 tempest-AttachVolumeShelveTestJSON-2005213506 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:36:50 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3020b2c1-ab2f-41ba-998c-7c43f6cea236 tempest-AttachVolumeShelveTestJSON-2005213506 None] Deleted volume successfully. Sep 05 11:36:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3020b2c1-ab2f-41ba-998c-7c43f6cea236 tempest-AttachVolumeShelveTestJSON-2005213506 None] Lock "cinder-8ce9e2a4-4cc7-4e64-a1a0-fe8a1630a546-delete_volume" released by "delete_volume" :: held 1.974s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:36:59 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=7,cinder:SELECT=5,cinder:INSERT=3 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:37:00 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:37:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-6e0e410b-c5b8-4802-b0db-8a1b4b031dc1 req-581badd3-90a9-4e04-a062-5f1332dd2040 tempest-ServerActionsTestOtherA-1878425266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:37:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-6e0e410b-c5b8-4802-b0db-8a1b4b031dc1 req-581badd3-90a9-4e04-a062-5f1332dd2040 tempest-ServerActionsTestOtherA-1878425266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:37:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-6e0e410b-c5b8-4802-b0db-8a1b4b031dc1 req-581badd3-90a9-4e04-a062-5f1332dd2040 tempest-ServerActionsTestOtherA-1878425266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:37:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-6e0e410b-c5b8-4802-b0db-8a1b4b031dc1 req-581badd3-90a9-4e04-a062-5f1332dd2040 tempest-ServerActionsTestOtherA-1878425266 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32', 'name': 'volume-316b4a8e-57e9-44a1-be4f-c7ff249279c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '965d97e8-73f3-4652-9157-acef56555bd4', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 11:37:12 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-6e0e410b-c5b8-4802-b0db-8a1b4b031dc1 req-581badd3-90a9-4e04-a062-5f1332dd2040 tempest-ServerActionsTestOtherA-1878425266 None] attachment_update completed successfully. Sep 05 11:37:16 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-dd25de50-4ec7-4daa-bac6-2af4dfca069f req-88b03f15-fe59-4680-b31e-5198a039eade tempest-ServerActionsTestOtherA-1878425266 None] Terminate volume connection completed successfully. Sep 05 11:37:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-dd25de50-4ec7-4daa-bac6-2af4dfca069f req-88b03f15-fe59-4680-b31e-5198a039eade tempest-ServerActionsTestOtherA-1878425266 None] Deleting attachment 965d97e8-73f3-4652-9157-acef56555bd4. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 11:37:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-dd25de50-4ec7-4daa-bac6-2af4dfca069f req-5d291c78-a8ae-49c5-82d4-c3d8661a82ac tempest-ServerActionsTestOtherA-1878425266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:37:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-dd25de50-4ec7-4daa-bac6-2af4dfca069f req-5d291c78-a8ae-49c5-82d4-c3d8661a82ac tempest-ServerActionsTestOtherA-1878425266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:37:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-dd25de50-4ec7-4daa-bac6-2af4dfca069f req-5d291c78-a8ae-49c5-82d4-c3d8661a82ac tempest-ServerActionsTestOtherA-1878425266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:37:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-dd25de50-4ec7-4daa-bac6-2af4dfca069f req-5d291c78-a8ae-49c5-82d4-c3d8661a82ac tempest-ServerActionsTestOtherA-1878425266 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32', 'name': 'volume-316b4a8e-57e9-44a1-be4f-c7ff249279c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d796249-3747-4742-920a-f7c58e81cc58', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 11:37:17 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-dd25de50-4ec7-4daa-bac6-2af4dfca069f req-5d291c78-a8ae-49c5-82d4-c3d8661a82ac tempest-ServerActionsTestOtherA-1878425266 None] attachment_update completed successfully. Sep 05 11:37:22 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-649bf79f-4a43-4fc4-8930-b995cda34d5e tempest-GroupsV314Test-1936817 None] Group tempest-GroupsV314Test-Group-607088314: creating Sep 05 11:37:22 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-649bf79f-4a43-4fc4-8930-b995cda34d5e tempest-GroupsV314Test-1936817 None] Group tempest-GroupsV314Test-Group-607088314: created successfully Sep 05 11:37:22 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-649bf79f-4a43-4fc4-8930-b995cda34d5e tempest-GroupsV314Test-1936817 None] Create group completed successfully. Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] Flow 'volume_create_manager' (77095b96-1b1b-41b7-b819-345074bcc152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c05cde4-1597-40f9-b5c6-bcd7cfafc4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c05cde4-1597-40f9-b5c6-bcd7cfafc4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-889330753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=057e07ee-8f3f-444c-a1fc-254530c79940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8374c04472439a8f0a15cf8c3a4079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:37:24Z,use_quota=True,user_id='eaf0397856844e479d015d5c72cd6898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abea1b58-26b7-4b1b-bdd6-837e27102e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abea1b58-26b7-4b1b-bdd6-837e27102e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a00e629-19ed-48a6-8ec6-7dfd98aaaa46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a00e629-19ed-48a6-8ec6-7dfd98aaaa46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '057e07ee-8f3f-444c-a1fc-254530c79940', 'volume_name': 'volume-057e07ee-8f3f-444c-a1fc-254530c79940', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b83142f7-4c84-4cab-80c6-a15494713d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b83142f7-4c84-4cab-80c6-a15494713d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e275cb-8a15-4502-9d93-6b404b7301b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:37:24 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] Volume 057e07ee-8f3f-444c-a1fc-254530c79940: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-057e07ee-8f3f-444c-a1fc-254530c79940', 'volume_size': 1} Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-889330753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=057e07ee-8f3f-444c-a1fc-254530c79940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8374c04472439a8f0a15cf8c3a4079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:37:24Z,use_quota=True,user_id='eaf0397856844e479d015d5c72cd6898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] Creating volume 057e07ee-8f3f-444c-a1fc-254530c79940 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:37:24 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-057e07ee-8f3f-444c-a1fc-254530c79940 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:24 devstack sudo[93805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-057e07ee-8f3f-444c-a1fc-254530c79940 1073741824 Sep 05 11:37:24 devstack sudo[93805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] Flow 'volume_create_manager' (21cc6ff5-33e9-418b-8efd-4776f718370a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88e9eb45-a807-407c-9cbd-2963ec6cbc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88e9eb45-a807-407c-9cbd-2963ec6cbc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-488577700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a774c79b-09d9-4b98-866f-1d587249dc13,host='devstack@QuobyteHD#QuobyteHD',id=d518a2ec-280a-45b0-9aca-7005993717d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='878eee6ed8424c3f9984315ac93bbb7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:37:25Z,use_quota=True,user_id='747f0cc0191a46fb81aed218530bfae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0ae7cd5-190a-4343-99a5-5fd5a7c405dc),volume_type_id=a0ae7cd5-190a-4343-99a5-5fd5a7c405dc)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d0b8231-5fe8-42dc-b7b7-e094dbb75795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d0b8231-5fe8-42dc-b7b7-e094dbb75795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9daac58-e0da-4869-999c-49667ccf74e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9daac58-e0da-4869-999c-49667ccf74e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd518a2ec-280a-45b0-9aca-7005993717d9', 'volume_name': 'volume-d518a2ec-280a-45b0-9aca-7005993717d9', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a9c734c-65f6-4d95-8dd4-8fb6416fcba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a9c734c-65f6-4d95-8dd4-8fb6416fcba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b376ad-b28f-4e4b-b1e8-e021bf0c52d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:37:24 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] Volume d518a2ec-280a-45b0-9aca-7005993717d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d518a2ec-280a-45b0-9aca-7005993717d9', 'volume_size': 1} Sep 05 11:37:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:37:25 devstack sudo[93805]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-057e07ee-8f3f-444c-a1fc-254530c79940 1073741824" returned: 0 in 0.478s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-057e07ee-8f3f-444c-a1fc-254530c79940 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:25 devstack sudo[93811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-057e07ee-8f3f-444c-a1fc-254530c79940 Sep 05 11:37:25 devstack sudo[93811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:25 devstack sudo[93811]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-057e07ee-8f3f-444c-a1fc-254530c79940" returned: 0 in 0.276s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:37:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:37:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.628s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:37:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a774c79b-09d9-4b98-866f-1d587249dc13,created_at=2026-09-05T09:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-488577700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a774c79b-09d9-4b98-866f-1d587249dc13,host='devstack@QuobyteHD#QuobyteHD',id=d518a2ec-280a-45b0-9aca-7005993717d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='878eee6ed8424c3f9984315ac93bbb7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:37:25Z,use_quota=True,user_id='747f0cc0191a46fb81aed218530bfae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0ae7cd5-190a-4343-99a5-5fd5a7c405dc),volume_type_id=a0ae7cd5-190a-4343-99a5-5fd5a7c405dc)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:37:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] Creating volume d518a2ec-280a-45b0-9aca-7005993717d9 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:37:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:37:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:37:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:37:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:37:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:37:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:37:25 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:37:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e275cb-8a15-4502-9d93-6b404b7301b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-057e07ee-8f3f-444c-a1fc-254530c79940', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:37:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b86cedf4-1e55-4f94-a77c-f14e053f96c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:37:25 devstack sudo[93814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9 1073741824 Sep 05 11:37:25 devstack sudo[93814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:25 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] Volume volume-057e07ee-8f3f-444c-a1fc-254530c79940 (057e07ee-8f3f-444c-a1fc-254530c79940): created successfully Sep 05 11:37:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b86cedf4-1e55-4f94-a77c-f14e053f96c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:37:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] Flow 'volume_create_manager' (77095b96-1b1b-41b7-b819-345074bcc152) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:37:25 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-9252aa83-872e-4a52-8186-4104a76d0b06 tempest-AttachVolumeNegativeTest-57248058 None] Created volume successfully. Sep 05 11:37:25 devstack sudo[93814]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9 1073741824" returned: 0 in 0.514s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:25 devstack sudo[93854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9 Sep 05 11:37:25 devstack sudo[93854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:26 devstack sudo[93854]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9" returned: 0 in 0.273s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:37:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:37:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b376ad-b28f-4e4b-b1e8-e021bf0c52d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d518a2ec-280a-45b0-9aca-7005993717d9', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:37:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc7d2cd7-b17d-458c-8a9f-63ada15b1721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:37:26 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] Volume volume-d518a2ec-280a-45b0-9aca-7005993717d9 (d518a2ec-280a-45b0-9aca-7005993717d9): created successfully Sep 05 11:37:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc7d2cd7-b17d-458c-8a9f-63ada15b1721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:37:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] Flow 'volume_create_manager' (21cc6ff5-33e9-418b-8efd-4776f718370a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:37:26 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-22cbbcc4-8f1b-4226-9a2e-a20ee20d0690 tempest-GroupsV314Test-1936817 None] Created volume successfully. Sep 05 11:37:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-d048bcf1-7fa7-48a3-a0b5-0261bab001c9 req-682d40e3-ef39-4070-878b-a3085b399839 tempest-AttachVolumeNegativeTest-57248058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:37:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-d048bcf1-7fa7-48a3-a0b5-0261bab001c9 req-682d40e3-ef39-4070-878b-a3085b399839 tempest-AttachVolumeNegativeTest-57248058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:37:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-d048bcf1-7fa7-48a3-a0b5-0261bab001c9 req-682d40e3-ef39-4070-878b-a3085b399839 tempest-AttachVolumeNegativeTest-57248058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:37:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-d048bcf1-7fa7-48a3-a0b5-0261bab001c9 req-682d40e3-ef39-4070-878b-a3085b399839 tempest-AttachVolumeNegativeTest-57248058 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32', 'name': 'volume-057e07ee-8f3f-444c-a1fc-254530c79940', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '30b6668d-e57b-4bc6-9fda-a7d654660c42', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 11:37:27 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-d048bcf1-7fa7-48a3-a0b5-0261bab001c9 req-682d40e3-ef39-4070-878b-a3085b399839 tempest-AttachVolumeNegativeTest-57248058 None] attachment_update completed successfully. Sep 05 11:37:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:37:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:37:27 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Cloning volume d518a2ec-280a-45b0-9aca-7005993717d9 to volume ad88281e-c2e6-4a49-80e5-e6a668771420 Sep 05 11:37:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Creating offline snapshot a287efe9-2848-4c66-9e7f-715cdeb846e8 of volume d518a2ec-280a-45b0-9aca-7005993717d9 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:37:27 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[736ee139-9bb1-4c67-bd15-25d767608182]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:37:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:28 devstack sudo[93902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9 Sep 05 11:37:28 devstack sudo[93902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:28 devstack sudo[93902]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9" returned: 0 in 0.560s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9.a287efe9-2848-4c66-9e7f-715cdeb846e8 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:28 devstack sudo[93907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9.a287efe9-2848-4c66-9e7f-715cdeb846e8 1G Sep 05 11:37:28 devstack sudo[93907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:28 devstack sudo[93907]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9.a287efe9-2848-4c66-9e7f-715cdeb846e8 1G" returned: 0 in 0.395s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d518a2ec-280a-45b0-9aca-7005993717d9 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9.a287efe9-2848-4c66-9e7f-715cdeb846e8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:28 devstack sudo[93912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d518a2ec-280a-45b0-9aca-7005993717d9 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9.a287efe9-2848-4c66-9e7f-715cdeb846e8 Sep 05 11:37:28 devstack sudo[93912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:29 devstack sudo[93912]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d518a2ec-280a-45b0-9aca-7005993717d9 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9.a287efe9-2848-4c66-9e7f-715cdeb846e8" returned: 0 in 0.322s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:29 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9.a287efe9-2848-4c66-9e7f-715cdeb846e8 is being set with open permissions: ugo+rw: NotImplementedError Sep 05 11:37:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9.a287efe9-2848-4c66-9e7f-715cdeb846e8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:29 devstack sudo[93917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9.a287efe9-2848-4c66-9e7f-715cdeb846e8 Sep 05 11:37:29 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:29 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9.a287efe9-2848-4c66-9e7f-715cdeb846e8" returned: 0 in 0.247s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:29 devstack sudo[93920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9.info Sep 05 11:37:29 devstack sudo[93920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:29 devstack sudo[93920]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9.info" returned: 0 in 0.336s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:29 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9.info is being set with open permissions: ugo+rw: NotImplementedError Sep 05 11:37:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:29 devstack sudo[93924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9.info Sep 05 11:37:29 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:30 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-059607e2-8737-477d-9951-6a601e29c7d1 req-186bee74-11f1-457e-89c3-48d78d5d9d92 tempest-AttachVolumeNegativeTest-57248058 None] Terminate volume connection completed successfully. Sep 05 11:37:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-059607e2-8737-477d-9951-6a601e29c7d1 req-186bee74-11f1-457e-89c3-48d78d5d9d92 tempest-AttachVolumeNegativeTest-57248058 None] Deleting attachment 30b6668d-e57b-4bc6-9fda-a7d654660c42. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 11:37:30 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9.info" returned: 0 in 0.316s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Acquiring lock "cinder-quobyte-ad88281e-c2e6-4a49-80e5-e6a668771420" by "_copy_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:37:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Lock "cinder-quobyte-ad88281e-c2e6-4a49-80e5-e6a668771420" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:37:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] snapshot: a287efe9-2848-4c66-9e7f-715cdeb846e8, volume: ad88281e-c2e6-4a49-80e5-e6a668771420, {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 11:37:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:37:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:37:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:37:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:37:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:37:30 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5df0cf-08b4-45b6-bea0-cc78afad4335]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:37:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9.a287efe9-2848-4c66-9e7f-715cdeb846e8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:30 devstack sudo[93930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9.a287efe9-2848-4c66-9e7f-715cdeb846e8 Sep 05 11:37:30 devstack sudo[93930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:30 devstack sudo[93930]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9.a287efe9-2848-4c66-9e7f-715cdeb846e8" returned: 0 in 0.441s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d518a2ec-280a-45b0-9aca-7005993717d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:37:30 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d123fbf-bf5d-46c5-a7b7-c20c972bfee9]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:37:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:30 devstack sudo[93935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9 Sep 05 11:37:30 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:31 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9" returned: 0 in 0.591s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9 {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 11:37:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Creating direct copy from snapshot {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 11:37:31 devstack cinder-volume[87517]: DEBUG cinder.utils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Path /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ad88281e-c2e6-4a49-80e5-e6a668771420 not found in is_blk_device check {{(pid=87517) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 11:37:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ad88281e-c2e6-4a49-80e5-e6a668771420 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:31 devstack sudo[93944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ad88281e-c2e6-4a49-80e5-e6a668771420 Sep 05 11:37:31 devstack sudo[93944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:37:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:37:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:37:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:37:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:37:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:37:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:32 devstack sudo[93972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:37:32 devstack sudo[93972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:33 devstack sudo[93972]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 1.361s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:33 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:37:33 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:37:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread count: 28 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 11:37:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread info: [<_MainThread(MainThread, started 131707869511808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 11:37:35 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:37:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Flow 'volume_create_manager' (2f8814d8-b185-4d65-b957-c8a2d347b696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:37:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf9a7c5a-3dea-4860-9f2b-16b9b2ec73d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:37:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf9a7c5a-3dea-4860-9f2b-16b9b2ec73d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-406955370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0098eb4c-d5c2-4ac8-99f2-0badc21d22fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='631a356e529f4b45867b59d1c77115ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:37:36Z,use_quota=True,user_id='747246c554ac4dbd8d2bb121c2f8f99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:37:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1e064e3-2e41-471f-aa7a-94e43f585e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:37:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1e064e3-2e41-471f-aa7a-94e43f585e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:37:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699e3d66-1244-4034-b9fe-de6d9c356209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:37:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699e3d66-1244-4034-b9fe-de6d9c356209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0098eb4c-d5c2-4ac8-99f2-0badc21d22fd', 'volume_name': 'volume-0098eb4c-d5c2-4ac8-99f2-0badc21d22fd', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:37:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (402a2b80-606d-42e7-8ed7-023fdef0bda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:37:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (402a2b80-606d-42e7-8ed7-023fdef0bda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:37:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8ff33ae-59df-41ee-b485-4152407ca963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:37:36 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Volume 0098eb4c-d5c2-4ac8-99f2-0badc21d22fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0098eb4c-d5c2-4ac8-99f2-0badc21d22fd', 'volume_size': 1} Sep 05 11:37:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:37:38 devstack sudo[93944]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ad88281e-c2e6-4a49-80e5-e6a668771420" returned: 0 in 7.160s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:38 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Image conversion details: src /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9, size 1024.00 MB, duration 7.16 sec, destination /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ad88281e-c2e6-4a49-80e5-e6a668771420 {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 11:37:38 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Converted 1024.00 MB image at 143.00 MB/s Sep 05 11:37:38 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ad88281e-c2e6-4a49-80e5-e6a668771420 is being set with open permissions: ugo+rw: NotImplementedError Sep 05 11:37:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ad88281e-c2e6-4a49-80e5-e6a668771420 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:38 devstack sudo[94005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ad88281e-c2e6-4a49-80e5-e6a668771420 Sep 05 11:37:38 devstack sudo[94005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:38 devstack sudo[94005]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ad88281e-c2e6-4a49-80e5-e6a668771420" returned: 0 in 0.266s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Lock "cinder-quobyte-ad88281e-c2e6-4a49-80e5-e6a668771420" released by "_copy_volume_from_snapshot" :: held 8.544s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:37:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Acquiring lock "cinder-quobyte-a287efe9-2848-4c66-9e7f-715cdeb846e8" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:37:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Lock "cinder-quobyte-a287efe9-2848-4c66-9e7f-715cdeb846e8" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:37:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Deleting offline snapshot a287efe9-2848-4c66-9e7f-715cdeb846e8 of volume d518a2ec-280a-45b0-9aca-7005993717d9 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:37:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] snapshot_file for this snap is: volume-d518a2ec-280a-45b0-9aca-7005993717d9.a287efe9-2848-4c66-9e7f-715cdeb846e8 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:37:38 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f14954-479d-4536-a695-6e338d8bfb62]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:37:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9.a287efe9-2848-4c66-9e7f-715cdeb846e8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:38 devstack sudo[94008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9.a287efe9-2848-4c66-9e7f-715cdeb846e8 Sep 05 11:37:38 devstack sudo[94008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:39 devstack sudo[94008]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9.a287efe9-2848-4c66-9e7f-715cdeb846e8" returned: 0 in 0.378s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d518a2ec-280a-45b0-9aca-7005993717d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:37:39 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[8457cb92-0797-4bdb-a707-19a8a81d412d]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:37:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:39 devstack sudo[94037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9 Sep 05 11:37:39 devstack sudo[94037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:39 devstack sudo[94037]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9" returned: 0 in 0.526s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9.a287efe9-2848-4c66-9e7f-715cdeb846e8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:39 devstack sudo[94042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9.a287efe9-2848-4c66-9e7f-715cdeb846e8 Sep 05 11:37:39 devstack sudo[94042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:40 devstack sudo[94042]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9.a287efe9-2848-4c66-9e7f-715cdeb846e8" returned: 0 in 0.398s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9.a287efe9-2848-4c66-9e7f-715cdeb846e8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:40 devstack sudo[94049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9.a287efe9-2848-4c66-9e7f-715cdeb846e8 Sep 05 11:37:40 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:40 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9.a287efe9-2848-4c66-9e7f-715cdeb846e8" returned: 0 in 0.267s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Lock "cinder-quobyte-a287efe9-2848-4c66-9e7f-715cdeb846e8" released by "_delete_snapshot" :: held 1.690s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:37:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.724s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:37:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.533s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:37:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-406955370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0098eb4c-d5c2-4ac8-99f2-0badc21d22fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='631a356e529f4b45867b59d1c77115ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:37:36Z,use_quota=True,user_id='747246c554ac4dbd8d2bb121c2f8f99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:37:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Creating volume 0098eb4c-d5c2-4ac8-99f2-0badc21d22fd {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:37:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:37:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:37:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:37:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:37:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:37:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:37:40 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:37:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0098eb4c-d5c2-4ac8-99f2-0badc21d22fd 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:40 devstack sudo[94052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0098eb4c-d5c2-4ac8-99f2-0badc21d22fd 1073741824 Sep 05 11:37:40 devstack sudo[94052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:40 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b5c20bb4-e69b-4e90-a39c-93c2c5870429 tempest-GroupsV314Test-1936817 None] Create group from source-group-a774c79b-09d9-4b98-866f-1d587249dc13 completed successfully. Sep 05 11:37:40 devstack sudo[94052]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0098eb4c-d5c2-4ac8-99f2-0badc21d22fd 1073741824" returned: 0 in 0.442s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0098eb4c-d5c2-4ac8-99f2-0badc21d22fd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:41 devstack sudo[94058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0098eb4c-d5c2-4ac8-99f2-0badc21d22fd Sep 05 11:37:41 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:41 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0098eb4c-d5c2-4ac8-99f2-0badc21d22fd" returned: 0 in 0.252s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:37:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:37:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8ff33ae-59df-41ee-b485-4152407ca963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0098eb4c-d5c2-4ac8-99f2-0badc21d22fd', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:37:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (428fd6eb-3459-4c6a-bbbc-21cf6c2918ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:37:41 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Volume volume-0098eb4c-d5c2-4ac8-99f2-0badc21d22fd (0098eb4c-d5c2-4ac8-99f2-0badc21d22fd): created successfully Sep 05 11:37:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (428fd6eb-3459-4c6a-bbbc-21cf6c2918ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:37:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Flow 'volume_create_manager' (2f8814d8-b185-4d65-b957-c8a2d347b696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:37:41 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-da3ec4ad-afbb-40e7-8727-f6a816abf1e6 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Created volume successfully. Sep 05 11:37:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-64d5c594-13b2-4fa1-ae92-a5eedb235f55 tempest-GroupsV314Test-1936817 None] Acquiring lock "cinder-quobyte-ad88281e-c2e6-4a49-80e5-e6a668771420" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:37:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-64d5c594-13b2-4fa1-ae92-a5eedb235f55 tempest-GroupsV314Test-1936817 None] Lock "cinder-quobyte-ad88281e-c2e6-4a49-80e5-e6a668771420" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:37:42 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f784b2b-740a-4e48-a70a-d2ebe4345dc7]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:37:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-64d5c594-13b2-4fa1-ae92-a5eedb235f55 tempest-GroupsV314Test-1936817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ad88281e-c2e6-4a49-80e5-e6a668771420 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:42 devstack sudo[94062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ad88281e-c2e6-4a49-80e5-e6a668771420 Sep 05 11:37:42 devstack sudo[94062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:42 devstack sudo[94062]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-64d5c594-13b2-4fa1-ae92-a5eedb235f55 tempest-GroupsV314Test-1936817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ad88281e-c2e6-4a49-80e5-e6a668771420" returned: 0 in 0.515s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-64d5c594-13b2-4fa1-ae92-a5eedb235f55 tempest-GroupsV314Test-1936817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ad88281e-c2e6-4a49-80e5-e6a668771420 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:42 devstack sudo[94074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ad88281e-c2e6-4a49-80e5-e6a668771420 Sep 05 11:37:42 devstack sudo[94074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:42 devstack sudo[94074]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-64d5c594-13b2-4fa1-ae92-a5eedb235f55 tempest-GroupsV314Test-1936817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ad88281e-c2e6-4a49-80e5-e6a668771420" returned: 0 in 0.291s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-64d5c594-13b2-4fa1-ae92-a5eedb235f55 tempest-GroupsV314Test-1936817 None] Lock "cinder-quobyte-ad88281e-c2e6-4a49-80e5-e6a668771420" released by "delete_volume" :: held 0.872s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:37:43 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-64d5c594-13b2-4fa1-ae92-a5eedb235f55 tempest-GroupsV314Test-1936817 None] Created reservations ['92bf1586-ecc8-41d7-9919-cf313392b5b3'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:37:43 devstack cinder-volume[87517]: WARNING cinder.quota [None req-64d5c594-13b2-4fa1-ae92-a5eedb235f55 tempest-GroupsV314Test-1936817 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1461640733 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1461640733, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:37:43 devstack cinder-volume[87517]: WARNING cinder.quota [None req-64d5c594-13b2-4fa1-ae92-a5eedb235f55 tempest-GroupsV314Test-1936817 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1461640733 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1461640733, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:37:43 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-64d5c594-13b2-4fa1-ae92-a5eedb235f55 tempest-GroupsV314Test-1936817 None] Created reservations ['b853e59c-1025-4a84-b4ca-7465ce1ffdbb', '1fc34d8b-af20-4138-854b-e25e46c8330f', '7b2e7633-7147-4e85-a0a0-6e27cc41212a', '33674c6f-b081-4832-95d8-03082ec0b170'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:37:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-c822b8e0-0726-4164-856b-8b03c383d3c6 req-31514dee-3339-48cc-bcc9-52da4c4e070d tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:37:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-c822b8e0-0726-4164-856b-8b03c383d3c6 req-31514dee-3339-48cc-bcc9-52da4c4e070d tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:37:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-c822b8e0-0726-4164-856b-8b03c383d3c6 req-31514dee-3339-48cc-bcc9-52da4c4e070d tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:37:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-c822b8e0-0726-4164-856b-8b03c383d3c6 req-31514dee-3339-48cc-bcc9-52da4c4e070d tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32', 'name': 'volume-0098eb4c-d5c2-4ac8-99f2-0badc21d22fd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'edad2860-71c1-4fb6-ab17-f994963996fb', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 11:37:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-64d5c594-13b2-4fa1-ae92-a5eedb235f55 tempest-GroupsV314Test-1936817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:37:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-64d5c594-13b2-4fa1-ae92-a5eedb235f55 tempest-GroupsV314Test-1936817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:37:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-64d5c594-13b2-4fa1-ae92-a5eedb235f55 tempest-GroupsV314Test-1936817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:37:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-64d5c594-13b2-4fa1-ae92-a5eedb235f55 tempest-GroupsV314Test-1936817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:37:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-64d5c594-13b2-4fa1-ae92-a5eedb235f55 tempest-GroupsV314Test-1936817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:37:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-64d5c594-13b2-4fa1-ae92-a5eedb235f55 tempest-GroupsV314Test-1936817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:43 devstack sudo[94087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:37:43 devstack sudo[94087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:43 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-c822b8e0-0726-4164-856b-8b03c383d3c6 req-31514dee-3339-48cc-bcc9-52da4c4e070d tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] attachment_update completed successfully. Sep 05 11:37:43 devstack sudo[94087]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-64d5c594-13b2-4fa1-ae92-a5eedb235f55 tempest-GroupsV314Test-1936817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.325s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:43 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-64d5c594-13b2-4fa1-ae92-a5eedb235f55 tempest-GroupsV314Test-1936817 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:37:43 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-64d5c594-13b2-4fa1-ae92-a5eedb235f55 tempest-GroupsV314Test-1936817 None] Delete group completed successfully. Sep 05 11:37:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-eb4f3544-2db6-4281-a4d6-03fd06ec8925 tempest-GroupsV314Test-1936817 None] Acquiring lock "cinder-quobyte-d518a2ec-280a-45b0-9aca-7005993717d9" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:37:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-eb4f3544-2db6-4281-a4d6-03fd06ec8925 tempest-GroupsV314Test-1936817 None] Lock "cinder-quobyte-d518a2ec-280a-45b0-9aca-7005993717d9" acquired by "delete_volume" :: waited 0.034s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:37:43 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[97431792-4d24-42d4-9de3-c13960c05d8f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:37:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eb4f3544-2db6-4281-a4d6-03fd06ec8925 tempest-GroupsV314Test-1936817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:43 devstack sudo[94092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9 Sep 05 11:37:43 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:44 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eb4f3544-2db6-4281-a4d6-03fd06ec8925 tempest-GroupsV314Test-1936817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9" returned: 0 in 0.552s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eb4f3544-2db6-4281-a4d6-03fd06ec8925 tempest-GroupsV314Test-1936817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:44 devstack sudo[94097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9 Sep 05 11:37:44 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:44 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eb4f3544-2db6-4281-a4d6-03fd06ec8925 tempest-GroupsV314Test-1936817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d518a2ec-280a-45b0-9aca-7005993717d9" returned: 0 in 0.302s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-eb4f3544-2db6-4281-a4d6-03fd06ec8925 tempest-GroupsV314Test-1936817 None] Lock "cinder-quobyte-d518a2ec-280a-45b0-9aca-7005993717d9" released by "delete_volume" :: held 0.990s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:37:44 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-eb4f3544-2db6-4281-a4d6-03fd06ec8925 tempest-GroupsV314Test-1936817 None] Created reservations ['dc4de31d-d958-4a30-b23c-ca032341f8d1'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:37:44 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-eb4f3544-2db6-4281-a4d6-03fd06ec8925 tempest-GroupsV314Test-1936817 None] Created reservations ['5af74a1c-0689-4056-a92b-7d554a0567e5', 'df04d77a-073b-493f-99d3-16cb7e6e5c71', '64b94443-9998-46c0-8688-7a4cc10c7895', 'ec31f83c-79e9-4ffe-8724-58f1350a309e'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:37:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-eb4f3544-2db6-4281-a4d6-03fd06ec8925 tempest-GroupsV314Test-1936817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:37:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-eb4f3544-2db6-4281-a4d6-03fd06ec8925 tempest-GroupsV314Test-1936817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:37:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-eb4f3544-2db6-4281-a4d6-03fd06ec8925 tempest-GroupsV314Test-1936817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:37:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-eb4f3544-2db6-4281-a4d6-03fd06ec8925 tempest-GroupsV314Test-1936817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:37:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-eb4f3544-2db6-4281-a4d6-03fd06ec8925 tempest-GroupsV314Test-1936817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:37:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eb4f3544-2db6-4281-a4d6-03fd06ec8925 tempest-GroupsV314Test-1936817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:45 devstack sudo[94110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:37:45 devstack sudo[94110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:45 devstack sudo[94110]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eb4f3544-2db6-4281-a4d6-03fd06ec8925 tempest-GroupsV314Test-1936817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.448s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:45 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-eb4f3544-2db6-4281-a4d6-03fd06ec8925 tempest-GroupsV314Test-1936817 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:37:45 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-eb4f3544-2db6-4281-a4d6-03fd06ec8925 tempest-GroupsV314Test-1936817 None] Delete group completed successfully. Sep 05 11:37:47 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-9bace986-b318-47cc-8324-71603a286176 req-b4066813-0b1d-4c0d-9bfc-1a33dceb6c97 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Terminate volume connection completed successfully. Sep 05 11:37:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-9bace986-b318-47cc-8324-71603a286176 req-b4066813-0b1d-4c0d-9bfc-1a33dceb6c97 tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Deleting attachment edad2860-71c1-4fb6-ab17-f994963996fb. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 11:37:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0b9d0ac9-9538-4eb2-beda-c8116b9fdb8c tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Acquiring lock "cinder-0098eb4c-d5c2-4ac8-99f2-0badc21d22fd-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:37:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0b9d0ac9-9538-4eb2-beda-c8116b9fdb8c tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Lock "cinder-0098eb4c-d5c2-4ac8-99f2-0badc21d22fd-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:37:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0b9d0ac9-9538-4eb2-beda-c8116b9fdb8c tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Acquiring lock "cinder-quobyte-0098eb4c-d5c2-4ac8-99f2-0badc21d22fd" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:37:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0b9d0ac9-9538-4eb2-beda-c8116b9fdb8c tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Lock "cinder-quobyte-0098eb4c-d5c2-4ac8-99f2-0badc21d22fd" acquired by "delete_volume" :: waited 0.031s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:37:48 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4853d5-a215-4993-9ee4-88e10a17cd16]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:37:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0b9d0ac9-9538-4eb2-beda-c8116b9fdb8c tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0098eb4c-d5c2-4ac8-99f2-0badc21d22fd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:48 devstack sudo[94181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0098eb4c-d5c2-4ac8-99f2-0badc21d22fd Sep 05 11:37:48 devstack sudo[94181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:48 devstack sudo[94181]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0b9d0ac9-9538-4eb2-beda-c8116b9fdb8c tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0098eb4c-d5c2-4ac8-99f2-0badc21d22fd" returned: 0 in 0.568s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0b9d0ac9-9538-4eb2-beda-c8116b9fdb8c tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0098eb4c-d5c2-4ac8-99f2-0badc21d22fd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:48 devstack sudo[94195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0098eb4c-d5c2-4ac8-99f2-0badc21d22fd Sep 05 11:37:48 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:49 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0b9d0ac9-9538-4eb2-beda-c8116b9fdb8c tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0098eb4c-d5c2-4ac8-99f2-0badc21d22fd" returned: 0 in 0.325s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0b9d0ac9-9538-4eb2-beda-c8116b9fdb8c tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Lock "cinder-quobyte-0098eb4c-d5c2-4ac8-99f2-0badc21d22fd" released by "delete_volume" :: held 0.988s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:37:49 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-0b9d0ac9-9538-4eb2-beda-c8116b9fdb8c tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Created reservations ['cde67f32-7a93-40a4-a676-0a7dc2e4c003', '6fc1cc66-6a5e-4837-aed9-7e2b14279b62', 'b5636eab-4217-4492-af05-2e88b9b9b4c0', '3d086be3-add1-43a2-995a-23b5f0c5a13f'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:37:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0b9d0ac9-9538-4eb2-beda-c8116b9fdb8c tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:37:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0b9d0ac9-9538-4eb2-beda-c8116b9fdb8c tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:37:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0b9d0ac9-9538-4eb2-beda-c8116b9fdb8c tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:37:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0b9d0ac9-9538-4eb2-beda-c8116b9fdb8c tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:37:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0b9d0ac9-9538-4eb2-beda-c8116b9fdb8c tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:37:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0b9d0ac9-9538-4eb2-beda-c8116b9fdb8c tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:49 devstack sudo[94201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:37:49 devstack sudo[94201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:49 devstack sudo[94201]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0b9d0ac9-9538-4eb2-beda-c8116b9fdb8c tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.338s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:49 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-0b9d0ac9-9538-4eb2-beda-c8116b9fdb8c tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:37:49 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-0b9d0ac9-9538-4eb2-beda-c8116b9fdb8c tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Deleted volume successfully. Sep 05 11:37:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0b9d0ac9-9538-4eb2-beda-c8116b9fdb8c tempest-TestServerVolumeAttachScenarioOldVersion-362462854 None] Lock "cinder-0098eb4c-d5c2-4ac8-99f2-0badc21d22fd-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:37:56 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:37:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] Flow 'volume_create_manager' (eecdfcff-f9a4-40da-b217-7b3d162aaecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:37:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d83d10-78b1-4160-bc2c-a8ed4d6707b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:37:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d83d10-78b1-4160-bc2c-a8ed4d6707b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-811130534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a620629-1351-4eda-b66d-14edb23fb6cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8432c8fb07c645a5ba828bf131901b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:37:56Z,use_quota=True,user_id='aa16eedfa9854ad0bc8494b70f9e7e4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:37:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a6d2388-40f7-4815-a123-50b9bb2e0569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:37:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a6d2388-40f7-4815-a123-50b9bb2e0569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:37:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3922283e-3a0e-4d51-8ab2-ecf1c0f1e6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:37:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3922283e-3a0e-4d51-8ab2-ecf1c0f1e6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a620629-1351-4eda-b66d-14edb23fb6cb', 'volume_name': 'volume-6a620629-1351-4eda-b66d-14edb23fb6cb', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:37:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0577bf-ec6a-4d23-a1c2-0b083e177952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:37:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0577bf-ec6a-4d23-a1c2-0b083e177952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:37:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b82664-aae2-4644-85d3-c37100e1e4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:37:56 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] Volume 6a620629-1351-4eda-b66d-14edb23fb6cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a620629-1351-4eda-b66d-14edb23fb6cb', 'volume_size': 1} Sep 05 11:37:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:37:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:37:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-811130534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a620629-1351-4eda-b66d-14edb23fb6cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8432c8fb07c645a5ba828bf131901b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:37:56Z,use_quota=True,user_id='aa16eedfa9854ad0bc8494b70f9e7e4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:37:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] Creating volume 6a620629-1351-4eda-b66d-14edb23fb6cb {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:37:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:37:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:37:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:37:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:37:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:37:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:37:56 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:37:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:56 devstack sudo[94236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb 1073741824 Sep 05 11:37:56 devstack sudo[94236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:56 devstack sudo[94236]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb 1073741824" returned: 0 in 0.549s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:56 devstack sudo[94242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb Sep 05 11:37:56 devstack sudo[94242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:57 devstack sudo[94242]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb" returned: 0 in 0.312s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:37:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:37:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b82664-aae2-4644-85d3-c37100e1e4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a620629-1351-4eda-b66d-14edb23fb6cb', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:37:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (737f3d42-d9e9-4f28-bb43-dcdd2c503c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:37:57 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] Volume volume-6a620629-1351-4eda-b66d-14edb23fb6cb (6a620629-1351-4eda-b66d-14edb23fb6cb): created successfully Sep 05 11:37:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (737f3d42-d9e9-4f28-bb43-dcdd2c503c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:37:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] Flow 'volume_create_manager' (eecdfcff-f9a4-40da-b217-7b3d162aaecb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:37:57 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-065d1684-f92e-4003-b9af-6e436d93b583 tempest-SnapshotsActionsTest-298787723 None] Created volume successfully. Sep 05 11:37:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9d71b258-2c95-489c-863f-a44184f5dffe tempest-SnapshotsActionsTest-298787723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:37:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9d71b258-2c95-489c-863f-a44184f5dffe tempest-SnapshotsActionsTest-298787723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:37:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-9d71b258-2c95-489c-863f-a44184f5dffe tempest-SnapshotsActionsTest-298787723 None] Creating offline snapshot f8285472-fc32-4a43-a291-102dfe55713e of volume 6a620629-1351-4eda-b66d-14edb23fb6cb {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:37:58 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecce748-d1c5-472d-9725-5c14ddb2636d]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:37:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9d71b258-2c95-489c-863f-a44184f5dffe tempest-SnapshotsActionsTest-298787723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:58 devstack sudo[94246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb Sep 05 11:37:58 devstack sudo[94246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:59 devstack sudo[94246]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9d71b258-2c95-489c-863f-a44184f5dffe tempest-SnapshotsActionsTest-298787723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb" returned: 0 in 0.488s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9d71b258-2c95-489c-863f-a44184f5dffe tempest-SnapshotsActionsTest-298787723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:59 devstack sudo[94254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e 1G Sep 05 11:37:59 devstack sudo[94254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:59 devstack sudo[94254]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9d71b258-2c95-489c-863f-a44184f5dffe tempest-SnapshotsActionsTest-298787723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e 1G" returned: 0 in 0.465s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9d71b258-2c95-489c-863f-a44184f5dffe tempest-SnapshotsActionsTest-298787723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a620629-1351-4eda-b66d-14edb23fb6cb -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:59 devstack sudo[94260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a620629-1351-4eda-b66d-14edb23fb6cb -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e Sep 05 11:37:59 devstack sudo[94260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:37:59 devstack sudo[94260]: pam_unix(sudo:session): session closed for user root Sep 05 11:37:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9d71b258-2c95-489c-863f-a44184f5dffe tempest-SnapshotsActionsTest-298787723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a620629-1351-4eda-b66d-14edb23fb6cb -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e" returned: 0 in 0.405s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:37:59 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-9d71b258-2c95-489c-863f-a44184f5dffe tempest-SnapshotsActionsTest-298787723 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e is being set with open permissions: ugo+rw Sep 05 11:37:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9d71b258-2c95-489c-863f-a44184f5dffe tempest-SnapshotsActionsTest-298787723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:37:59 devstack sudo[94267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e Sep 05 11:37:59 devstack sudo[94267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:00 devstack sudo[94267]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9d71b258-2c95-489c-863f-a44184f5dffe tempest-SnapshotsActionsTest-298787723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e" returned: 0 in 0.460s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9d71b258-2c95-489c-863f-a44184f5dffe tempest-SnapshotsActionsTest-298787723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:00 devstack sudo[94271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.info Sep 05 11:38:00 devstack sudo[94271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:00 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-617e044c-0a24-4dba-a582-f57e63d3e6a4 req-734dc9fb-465d-42f1-b518-b7e074b86cd4 tempest-ServerActionsTestOtherA-1878425266 None] Terminate volume connection completed successfully. Sep 05 11:38:00 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-617e044c-0a24-4dba-a582-f57e63d3e6a4 req-734dc9fb-465d-42f1-b518-b7e074b86cd4 tempest-ServerActionsTestOtherA-1878425266 None] Deleting attachment 7d796249-3747-4742-920a-f7c58e81cc58. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 11:38:00 devstack sudo[94271]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9d71b258-2c95-489c-863f-a44184f5dffe tempest-SnapshotsActionsTest-298787723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.info" returned: 0 in 0.423s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:00 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-9d71b258-2c95-489c-863f-a44184f5dffe tempest-SnapshotsActionsTest-298787723 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.info is being set with open permissions: ugo+rw Sep 05 11:38:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9d71b258-2c95-489c-863f-a44184f5dffe tempest-SnapshotsActionsTest-298787723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:00 devstack sudo[94276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.info Sep 05 11:38:00 devstack sudo[94276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:01 devstack sudo[94276]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9d71b258-2c95-489c-863f-a44184f5dffe tempest-SnapshotsActionsTest-298787723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.info" returned: 0 in 0.313s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9d71b258-2c95-489c-863f-a44184f5dffe tempest-SnapshotsActionsTest-298787723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.689s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:38:01 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-9d71b258-2c95-489c-863f-a44184f5dffe tempest-SnapshotsActionsTest-298787723 None] Create snapshot completed successfully Sep 05 11:38:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3043a9f9-4c1e-48a5-b344-8f3cdb3c33e1 tempest-SnapshotsActionsTest-298787723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:38:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3043a9f9-4c1e-48a5-b344-8f3cdb3c33e1 tempest-SnapshotsActionsTest-298787723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:38:02 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3043a9f9-4c1e-48a5-b344-8f3cdb3c33e1 tempest-SnapshotsActionsTest-298787723 None] Creating offline snapshot d5e9aafc-e7d0-442e-a69d-2a0c419aa5a6 of volume 6a620629-1351-4eda-b66d-14edb23fb6cb {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:38:03 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25ba66f-906f-48e7-b683-8aba12af8e6c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:38:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3043a9f9-4c1e-48a5-b344-8f3cdb3c33e1 tempest-SnapshotsActionsTest-298787723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:03 devstack sudo[94327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e Sep 05 11:38:03 devstack sudo[94327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:03 devstack sudo[94327]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3043a9f9-4c1e-48a5-b344-8f3cdb3c33e1 tempest-SnapshotsActionsTest-298787723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e" returned: 0 in 0.488s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3043a9f9-4c1e-48a5-b344-8f3cdb3c33e1 tempest-SnapshotsActionsTest-298787723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a620629-1351-4eda-b66d-14edb23fb6cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:38:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3043a9f9-4c1e-48a5-b344-8f3cdb3c33e1 tempest-SnapshotsActionsTest-298787723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.d5e9aafc-e7d0-442e-a69d-2a0c419aa5a6 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:03 devstack sudo[94332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.d5e9aafc-e7d0-442e-a69d-2a0c419aa5a6 1G Sep 05 11:38:03 devstack sudo[94332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:04 devstack sudo[94332]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3043a9f9-4c1e-48a5-b344-8f3cdb3c33e1 tempest-SnapshotsActionsTest-298787723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.d5e9aafc-e7d0-442e-a69d-2a0c419aa5a6 1G" returned: 0 in 0.684s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3043a9f9-4c1e-48a5-b344-8f3cdb3c33e1 tempest-SnapshotsActionsTest-298787723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.d5e9aafc-e7d0-442e-a69d-2a0c419aa5a6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:04 devstack sudo[94341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.d5e9aafc-e7d0-442e-a69d-2a0c419aa5a6 Sep 05 11:38:04 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:04 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3043a9f9-4c1e-48a5-b344-8f3cdb3c33e1 tempest-SnapshotsActionsTest-298787723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.d5e9aafc-e7d0-442e-a69d-2a0c419aa5a6" returned: 0 in 0.437s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:04 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-3043a9f9-4c1e-48a5-b344-8f3cdb3c33e1 tempest-SnapshotsActionsTest-298787723 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.d5e9aafc-e7d0-442e-a69d-2a0c419aa5a6 is being set with open permissions: ugo+rw Sep 05 11:38:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3043a9f9-4c1e-48a5-b344-8f3cdb3c33e1 tempest-SnapshotsActionsTest-298787723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.d5e9aafc-e7d0-442e-a69d-2a0c419aa5a6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:04 devstack sudo[94348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.d5e9aafc-e7d0-442e-a69d-2a0c419aa5a6 Sep 05 11:38:04 devstack sudo[94348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:05 devstack sudo[94348]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3043a9f9-4c1e-48a5-b344-8f3cdb3c33e1 tempest-SnapshotsActionsTest-298787723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.d5e9aafc-e7d0-442e-a69d-2a0c419aa5a6" returned: 0 in 0.326s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3043a9f9-4c1e-48a5-b344-8f3cdb3c33e1 tempest-SnapshotsActionsTest-298787723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.131s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:38:05 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3043a9f9-4c1e-48a5-b344-8f3cdb3c33e1 tempest-SnapshotsActionsTest-298787723 None] Create snapshot completed successfully Sep 05 11:38:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-600b63be-3da3-4bb7-a720-5c8d8665c7b8 tempest-SnapshotsActionsTest-790885362 None] Acquiring lock "cinder-d5e9aafc-e7d0-442e-a69d-2a0c419aa5a6-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:38:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-600b63be-3da3-4bb7-a720-5c8d8665c7b8 tempest-SnapshotsActionsTest-790885362 None] Lock "cinder-d5e9aafc-e7d0-442e-a69d-2a0c419aa5a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:38:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-600b63be-3da3-4bb7-a720-5c8d8665c7b8 tempest-SnapshotsActionsTest-790885362 None] Acquiring lock "cinder-quobyte-6a620629-1351-4eda-b66d-14edb23fb6cb" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:38:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-600b63be-3da3-4bb7-a720-5c8d8665c7b8 tempest-SnapshotsActionsTest-790885362 None] Lock "cinder-quobyte-6a620629-1351-4eda-b66d-14edb23fb6cb" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:38:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-600b63be-3da3-4bb7-a720-5c8d8665c7b8 tempest-SnapshotsActionsTest-790885362 None] Acquiring lock "cinder-quobyte-d5e9aafc-e7d0-442e-a69d-2a0c419aa5a6" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:38:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-600b63be-3da3-4bb7-a720-5c8d8665c7b8 tempest-SnapshotsActionsTest-790885362 None] Lock "cinder-quobyte-d5e9aafc-e7d0-442e-a69d-2a0c419aa5a6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:38:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-600b63be-3da3-4bb7-a720-5c8d8665c7b8 tempest-SnapshotsActionsTest-790885362 None] Deleting offline snapshot d5e9aafc-e7d0-442e-a69d-2a0c419aa5a6 of volume 6a620629-1351-4eda-b66d-14edb23fb6cb {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:38:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-600b63be-3da3-4bb7-a720-5c8d8665c7b8 tempest-SnapshotsActionsTest-790885362 None] snapshot_file for this snap is: volume-6a620629-1351-4eda-b66d-14edb23fb6cb.d5e9aafc-e7d0-442e-a69d-2a0c419aa5a6 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:38:06 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c49af7-4cc1-49da-a702-111c23213bda]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:38:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-600b63be-3da3-4bb7-a720-5c8d8665c7b8 tempest-SnapshotsActionsTest-790885362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.d5e9aafc-e7d0-442e-a69d-2a0c419aa5a6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:06 devstack sudo[94351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.d5e9aafc-e7d0-442e-a69d-2a0c419aa5a6 Sep 05 11:38:06 devstack sudo[94351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:06 devstack sudo[94351]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-600b63be-3da3-4bb7-a720-5c8d8665c7b8 tempest-SnapshotsActionsTest-790885362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.d5e9aafc-e7d0-442e-a69d-2a0c419aa5a6" returned: 0 in 0.501s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-600b63be-3da3-4bb7-a720-5c8d8665c7b8 tempest-SnapshotsActionsTest-790885362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a620629-1351-4eda-b66d-14edb23fb6cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:38:06 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06a6ecf-8eb3-4ef8-b427-6692c549d3c4]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:38:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-600b63be-3da3-4bb7-a720-5c8d8665c7b8 tempest-SnapshotsActionsTest-790885362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:07 devstack sudo[94356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e Sep 05 11:38:07 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:07 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-600b63be-3da3-4bb7-a720-5c8d8665c7b8 tempest-SnapshotsActionsTest-790885362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e" returned: 0 in 0.447s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-600b63be-3da3-4bb7-a720-5c8d8665c7b8 tempest-SnapshotsActionsTest-790885362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a620629-1351-4eda-b66d-14edb23fb6cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:38:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-600b63be-3da3-4bb7-a720-5c8d8665c7b8 tempest-SnapshotsActionsTest-790885362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.d5e9aafc-e7d0-442e-a69d-2a0c419aa5a6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:07 devstack sudo[94362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.d5e9aafc-e7d0-442e-a69d-2a0c419aa5a6 Sep 05 11:38:07 devstack sudo[94362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:07 devstack sudo[94362]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-600b63be-3da3-4bb7-a720-5c8d8665c7b8 tempest-SnapshotsActionsTest-790885362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.d5e9aafc-e7d0-442e-a69d-2a0c419aa5a6" returned: 0 in 0.532s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-600b63be-3da3-4bb7-a720-5c8d8665c7b8 tempest-SnapshotsActionsTest-790885362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.d5e9aafc-e7d0-442e-a69d-2a0c419aa5a6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:07 devstack sudo[94368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.d5e9aafc-e7d0-442e-a69d-2a0c419aa5a6 Sep 05 11:38:07 devstack sudo[94368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:08 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:38:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Flow 'volume_create_manager' (bf69eb99-a0a0-4762-9664-7d8cdf993f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:38:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af965ae6-b727-41de-bee5-1c2cb6cebdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:38:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af965ae6-b727-41de-bee5-1c2cb6cebdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-705075909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45defce6-ca3a-4372-ab75-23a77a7e5fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a58c22f50ee3475586aa7c1adc7bb46d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:38:08Z,use_quota=True,user_id='23146f486fb248ad8401941c71fa972f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:38:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc4fce1a-990c-4ea3-92f3-02ac29c527e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:38:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc4fce1a-990c-4ea3-92f3-02ac29c527e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:38:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8571ab4a-add9-4f3c-b3c3-72a0e6e76e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:38:08 devstack cinder-volume[87517]: DEBUG cinder.image.glance [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Creating Keystone auth plugin from conf {{(pid=87517) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 11:38:08 devstack sudo[94368]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-600b63be-3da3-4bb7-a720-5c8d8665c7b8 tempest-SnapshotsActionsTest-790885362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.d5e9aafc-e7d0-442e-a69d-2a0c419aa5a6" returned: 0 in 0.305s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-600b63be-3da3-4bb7-a720-5c8d8665c7b8 tempest-SnapshotsActionsTest-790885362 None] Lock "cinder-quobyte-d5e9aafc-e7d0-442e-a69d-2a0c419aa5a6" released by "_delete_snapshot" :: held 1.921s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:38:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-600b63be-3da3-4bb7-a720-5c8d8665c7b8 tempest-SnapshotsActionsTest-790885362 None] Lock "cinder-quobyte-6a620629-1351-4eda-b66d-14edb23fb6cb" released by "delete_snapshot" :: held 1.948s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:38:08 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-600b63be-3da3-4bb7-a720-5c8d8665c7b8 tempest-SnapshotsActionsTest-790885362 None] Created reservations ['5b1fc78c-aac0-41e8-b2be-86195353d8aa', 'a72e3ec8-d89c-41b2-9a53-b66db04e8edb', '96f41f71-fbe8-4552-92a4-8e1e831b61ad', '6888685d-20b0-481a-8355-8d7489d4f8ce'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:38:08 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-600b63be-3da3-4bb7-a720-5c8d8665c7b8 tempest-SnapshotsActionsTest-790885362 None] Delete snapshot completed successfully. Sep 05 11:38:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-600b63be-3da3-4bb7-a720-5c8d8665c7b8 tempest-SnapshotsActionsTest-790885362 None] Lock "cinder-d5e9aafc-e7d0-442e-a69d-2a0c419aa5a6-delete_snapshot" released by "delete_snapshot" :: held 2.162s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:38:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8571ab4a-add9-4f3c-b3c3-72a0e6e76e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '45defce6-ca3a-4372-ab75-23a77a7e5fe7', 'volume_name': 'volume-45defce6-ca3a-4372-ab75-23a77a7e5fe7', 'volume_size': 1, 'image_id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c73a992b4ff1451ca3178925081bf687', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'created_at': datetime.datetime(2026, 9, 5, 9, 26, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 9, 26, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:38:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29f9de20-1a62-4075-a986-863045506ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:38:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29f9de20-1a62-4075-a986-863045506ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:38:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d2a557b-71e3-43a2-8114-6b771f2e8494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:38:08 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Volume 45defce6-ca3a-4372-ab75-23a77a7e5fe7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-45defce6-ca3a-4372-ab75-23a77a7e5fe7', 'volume_size': 1, 'image_id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c73a992b4ff1451ca3178925081bf687', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'created_at': datetime.datetime(2026, 9, 5, 9, 26, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 9, 26, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 05 11:38:08 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Trying to clone 45defce6-ca3a-4372-ab75-23a77a7e5fe7 from image fff52cc1-bd64-4eb0-8735-62bad8dd7741 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'metadata': {}}]). {{(pid=87517) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 11:38:08 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_axtcztjzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 11:38:08 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Image download 20.69 MB at 20.69 MB/s Sep 05 11:38:09 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f147b45b-a1fd-4a43-88f2-2cbd801005c7]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:38:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_axtcztjzdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:09 devstack sudo[94372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_axtcztjzdevstack@QuobyteHD Sep 05 11:38:09 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:09 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_axtcztjzdevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:09 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Temporary image fff52cc1-bd64-4eb0-8735-62bad8dd7741 is fetched for user 23146f486fb248ad8401941c71fa972f. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 11:38:09 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6e3807-5fb3-4f41-96ce-c0e69396089c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:38:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_axtcztjzdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:09 devstack sudo[94377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_axtcztjzdevstack@QuobyteHD Sep 05 11:38:09 devstack sudo[94377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:09 devstack sudo[94377]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_axtcztjzdevstack@QuobyteHD" returned: 0 in 0.422s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:38:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:38:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-705075909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45defce6-ca3a-4372-ab75-23a77a7e5fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a58c22f50ee3475586aa7c1adc7bb46d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:38:08Z,use_quota=True,user_id='23146f486fb248ad8401941c71fa972f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:38:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Creating volume 45defce6-ca3a-4372-ab75-23a77a7e5fe7 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:38:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:38:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:38:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:38:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:38:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:38:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:38:09 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:38:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-45defce6-ca3a-4372-ab75-23a77a7e5fe7 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-61d82c42-6061-447f-93ab-31a227940f91 tempest-SnapshotsActionsTest-298787723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:38:10 devstack sudo[94383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-45defce6-ca3a-4372-ab75-23a77a7e5fe7 1073741824 Sep 05 11:38:10 devstack sudo[94383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:10 devstack sudo[94383]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-45defce6-ca3a-4372-ab75-23a77a7e5fe7 1073741824" returned: 0 in 0.496s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:10 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=88,cinder:UPDATE=54,cinder:INSERT=14,cinder:DELETE=4 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:38:10 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=76,cinder:UPDATE=70,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:38:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-45defce6-ca3a-4372-ab75-23a77a7e5fe7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:10 devstack sudo[94389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-45defce6-ca3a-4372-ab75-23a77a7e5fe7 Sep 05 11:38:10 devstack sudo[94389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:10 devstack sudo[94389]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-45defce6-ca3a-4372-ab75-23a77a7e5fe7" returned: 0 in 0.282s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:38:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:38:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-61d82c42-6061-447f-93ab-31a227940f91 tempest-SnapshotsActionsTest-298787723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.795s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:38:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-61d82c42-6061-447f-93ab-31a227940f91 tempest-SnapshotsActionsTest-298787723 None] Creating offline snapshot 830eb289-e535-435d-95a7-e8d8f41ce062 of volume 6a620629-1351-4eda-b66d-14edb23fb6cb {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:38:10 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d404da0-d224-401d-911b-bb05f64de1d9]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:38:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-61d82c42-6061-447f-93ab-31a227940f91 tempest-SnapshotsActionsTest-298787723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:10 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Attempting download of fff52cc1-bd64-4eb0-8735-62bad8dd7741 ((None, [{'url': 'file:///opt/stack/data/glance/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'metadata': {}}])) to volume 45defce6-ca3a-4372-ab75-23a77a7e5fe7. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 11:38:11 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7072e2a0-b149-4ea9-915f-4bc4061a4d65]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:38:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741_kryfsslm {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:11 devstack sudo[94392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e Sep 05 11:38:11 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:11 devstack sudo[94393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741_kryfsslm Sep 05 11:38:11 devstack sudo[94393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:11 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-61d82c42-6061-447f-93ab-31a227940f91 tempest-SnapshotsActionsTest-298787723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e" returned: 0 in 0.488s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-61d82c42-6061-447f-93ab-31a227940f91 tempest-SnapshotsActionsTest-298787723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a620629-1351-4eda-b66d-14edb23fb6cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:38:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-61d82c42-6061-447f-93ab-31a227940f91 tempest-SnapshotsActionsTest-298787723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.830eb289-e535-435d-95a7-e8d8f41ce062 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:11 devstack sudo[94393]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741_kryfsslm" returned: 0 in 0.395s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741_kryfsslm {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:11 devstack sudo[94402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.830eb289-e535-435d-95a7-e8d8f41ce062 1G Sep 05 11:38:11 devstack sudo[94402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:11 devstack sudo[94403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741_kryfsslm Sep 05 11:38:11 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:11 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741_kryfsslm" returned: 1 in 0.377s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741_kryfsslm' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 11:38:11 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b61f51f-f901-47dd-97c8-d88758dbd919]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:38:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_axtcztjzdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:11 devstack sudo[94412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_axtcztjzdevstack@QuobyteHD Sep 05 11:38:11 devstack sudo[94412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:11 devstack sudo[94402]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-61d82c42-6061-447f-93ab-31a227940f91 tempest-SnapshotsActionsTest-298787723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.830eb289-e535-435d-95a7-e8d8f41ce062 1G" returned: 0 in 0.537s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-61d82c42-6061-447f-93ab-31a227940f91 tempest-SnapshotsActionsTest-298787723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.830eb289-e535-435d-95a7-e8d8f41ce062 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:11 devstack sudo[94414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.830eb289-e535-435d-95a7-e8d8f41ce062 Sep 05 11:38:11 devstack sudo[94414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:12 devstack sudo[94412]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_axtcztjzdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:12 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] fff52cc1-bd64-4eb0-8735-62bad8dd7741 was qcow2, converting to qcow2 {{(pid=87517) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 11:38:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_axtcztjzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-45defce6-ca3a-4372-ab75-23a77a7e5fe7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:12 devstack sudo[94419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_axtcztjzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-45defce6-ca3a-4372-ab75-23a77a7e5fe7 Sep 05 11:38:12 devstack sudo[94419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:12 devstack sudo[94414]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-61d82c42-6061-447f-93ab-31a227940f91 tempest-SnapshotsActionsTest-298787723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.830eb289-e535-435d-95a7-e8d8f41ce062" returned: 0 in 0.393s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:12 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-61d82c42-6061-447f-93ab-31a227940f91 tempest-SnapshotsActionsTest-298787723 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.830eb289-e535-435d-95a7-e8d8f41ce062 is being set with open permissions: ugo+rw Sep 05 11:38:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-61d82c42-6061-447f-93ab-31a227940f91 tempest-SnapshotsActionsTest-298787723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.830eb289-e535-435d-95a7-e8d8f41ce062 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:12 devstack sudo[94425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.830eb289-e535-435d-95a7-e8d8f41ce062 Sep 05 11:38:12 devstack sudo[94425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:12 devstack sudo[94425]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-61d82c42-6061-447f-93ab-31a227940f91 tempest-SnapshotsActionsTest-298787723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.830eb289-e535-435d-95a7-e8d8f41ce062" returned: 0 in 0.247s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-61d82c42-6061-447f-93ab-31a227940f91 tempest-SnapshotsActionsTest-298787723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.787s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:38:12 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-61d82c42-6061-447f-93ab-31a227940f91 tempest-SnapshotsActionsTest-298787723 None] Create snapshot completed successfully Sep 05 11:38:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d6e4372-b251-41e1-872d-5024221dfa2a tempest-SnapshotsActionsTest-790885362 None] Acquiring lock "cinder-830eb289-e535-435d-95a7-e8d8f41ce062-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:38:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d6e4372-b251-41e1-872d-5024221dfa2a tempest-SnapshotsActionsTest-790885362 None] Lock "cinder-830eb289-e535-435d-95a7-e8d8f41ce062-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:38:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d6e4372-b251-41e1-872d-5024221dfa2a tempest-SnapshotsActionsTest-790885362 None] Acquiring lock "cinder-quobyte-6a620629-1351-4eda-b66d-14edb23fb6cb" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:38:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d6e4372-b251-41e1-872d-5024221dfa2a tempest-SnapshotsActionsTest-790885362 None] Lock "cinder-quobyte-6a620629-1351-4eda-b66d-14edb23fb6cb" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:38:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d6e4372-b251-41e1-872d-5024221dfa2a tempest-SnapshotsActionsTest-790885362 None] Acquiring lock "cinder-quobyte-830eb289-e535-435d-95a7-e8d8f41ce062" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:38:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d6e4372-b251-41e1-872d-5024221dfa2a tempest-SnapshotsActionsTest-790885362 None] Lock "cinder-quobyte-830eb289-e535-435d-95a7-e8d8f41ce062" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:38:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-1d6e4372-b251-41e1-872d-5024221dfa2a tempest-SnapshotsActionsTest-790885362 None] Deleting offline snapshot 830eb289-e535-435d-95a7-e8d8f41ce062 of volume 6a620629-1351-4eda-b66d-14edb23fb6cb {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:38:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-1d6e4372-b251-41e1-872d-5024221dfa2a tempest-SnapshotsActionsTest-790885362 None] snapshot_file for this snap is: volume-6a620629-1351-4eda-b66d-14edb23fb6cb.830eb289-e535-435d-95a7-e8d8f41ce062 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:38:13 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f446ae16-1b72-444a-8fbb-dae01e2188dd]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:38:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d6e4372-b251-41e1-872d-5024221dfa2a tempest-SnapshotsActionsTest-790885362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.830eb289-e535-435d-95a7-e8d8f41ce062 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:13 devstack sudo[94434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.830eb289-e535-435d-95a7-e8d8f41ce062 Sep 05 11:38:13 devstack sudo[94434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:13 devstack sudo[94434]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d6e4372-b251-41e1-872d-5024221dfa2a tempest-SnapshotsActionsTest-790885362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.830eb289-e535-435d-95a7-e8d8f41ce062" returned: 0 in 0.477s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-1d6e4372-b251-41e1-872d-5024221dfa2a tempest-SnapshotsActionsTest-790885362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a620629-1351-4eda-b66d-14edb23fb6cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:38:13 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5d99c3-d5ca-4dcc-bad8-d58db62ac0d1]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:38:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d6e4372-b251-41e1-872d-5024221dfa2a tempest-SnapshotsActionsTest-790885362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:14 devstack sudo[94441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e Sep 05 11:38:14 devstack sudo[94441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:14 devstack sudo[94441]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d6e4372-b251-41e1-872d-5024221dfa2a tempest-SnapshotsActionsTest-790885362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e" returned: 0 in 0.536s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-1d6e4372-b251-41e1-872d-5024221dfa2a tempest-SnapshotsActionsTest-790885362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a620629-1351-4eda-b66d-14edb23fb6cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:38:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d6e4372-b251-41e1-872d-5024221dfa2a tempest-SnapshotsActionsTest-790885362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.830eb289-e535-435d-95a7-e8d8f41ce062 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:14 devstack sudo[94446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.830eb289-e535-435d-95a7-e8d8f41ce062 Sep 05 11:38:14 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:14 devstack sudo[94419]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_axtcztjzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-45defce6-ca3a-4372-ab75-23a77a7e5fe7" returned: 0 in 2.462s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:14 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_axtcztjzdevstack@QuobyteHD, size 112.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-45defce6-ca3a-4372-ab75-23a77a7e5fe7 {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 11:38:14 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Converted 112.00 MB image at 45.41 MB/s Sep 05 11:38:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-45defce6-ca3a-4372-ab75-23a77a7e5fe7 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:14 devstack sudo[94448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-45defce6-ca3a-4372-ab75-23a77a7e5fe7 1G Sep 05 11:38:14 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:14 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:38:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] Flow 'volume_create_manager' (2d6549db-715a-4282-ae55-15bcad4a90b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:38:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (118a8247-2e21-430b-bf60-19a722b3eec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:38:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (118a8247-2e21-430b-bf60-19a722b3eec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1972371583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=019ef21d-1131-4d48-bc01-8a881a657670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8374c04472439a8f0a15cf8c3a4079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:38:15Z,use_quota=True,user_id='eaf0397856844e479d015d5c72cd6898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:38:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0be3f057-1fbc-432a-b1f4-0bc20f91bcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:38:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0be3f057-1fbc-432a-b1f4-0bc20f91bcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:38:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f44e116-27b0-4475-847e-4a9595047275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:38:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f44e116-27b0-4475-847e-4a9595047275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '019ef21d-1131-4d48-bc01-8a881a657670', 'volume_name': 'volume-019ef21d-1131-4d48-bc01-8a881a657670', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:38:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b495b336-46ad-42e0-8a94-c789a455dffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:38:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b495b336-46ad-42e0-8a94-c789a455dffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:38:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d78a69d-626f-482a-ba82-3de42a3cc8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:38:14 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] Volume 019ef21d-1131-4d48-bc01-8a881a657670: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-019ef21d-1131-4d48-bc01-8a881a657670', 'volume_size': 1} Sep 05 11:38:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:38:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:38:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1972371583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=019ef21d-1131-4d48-bc01-8a881a657670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8374c04472439a8f0a15cf8c3a4079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:38:15Z,use_quota=True,user_id='eaf0397856844e479d015d5c72cd6898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:38:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] Creating volume 019ef21d-1131-4d48-bc01-8a881a657670 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:38:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:38:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:38:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:38:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:38:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:38:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:38:14 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:38:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-019ef21d-1131-4d48-bc01-8a881a657670 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:14 devstack sudo[94452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-019ef21d-1131-4d48-bc01-8a881a657670 1073741824 Sep 05 11:38:14 devstack sudo[94452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:15 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d6e4372-b251-41e1-872d-5024221dfa2a tempest-SnapshotsActionsTest-790885362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.830eb289-e535-435d-95a7-e8d8f41ce062" returned: 0 in 0.524s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d6e4372-b251-41e1-872d-5024221dfa2a tempest-SnapshotsActionsTest-790885362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.830eb289-e535-435d-95a7-e8d8f41ce062 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:15 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-45defce6-ca3a-4372-ab75-23a77a7e5fe7 1G" returned: 0 in 0.419s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:15 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Downloaded image fff52cc1-bd64-4eb0-8735-62bad8dd7741 ((None, [{'url': 'file:///opt/stack/data/glance/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'metadata': {}}])) to volume 45defce6-ca3a-4372-ab75-23a77a7e5fe7 successfully. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 11:38:15 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Temporary image fff52cc1-bd64-4eb0-8735-62bad8dd7741 for user 23146f486fb248ad8401941c71fa972f is deleted. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 11:38:15 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Marking volume 45defce6-ca3a-4372-ab75-23a77a7e5fe7 as bootable. {{(pid=87517) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 11:38:15 devstack sudo[94460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.830eb289-e535-435d-95a7-e8d8f41ce062 Sep 05 11:38:15 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:15 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Copying metadata from image fff52cc1-bd64-4eb0-8735-62bad8dd7741 to 45defce6-ca3a-4372-ab75-23a77a7e5fe7. {{(pid=87517) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 11:38:15 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Creating volume glance metadata for volume 45defce6-ca3a-4372-ab75-23a77a7e5fe7 backed by image fff52cc1-bd64-4eb0-8735-62bad8dd7741 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87517) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 11:38:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d2a557b-71e3-43a2-8114-6b771f2e8494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45defce6-ca3a-4372-ab75-23a77a7e5fe7', 'volume_size': 1, 'image_id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c73a992b4ff1451ca3178925081bf687', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'created_at': datetime.datetime(2026, 9, 5, 9, 26, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 9, 26, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:38:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (888e20b6-fe0b-4b2a-958c-184c10c621a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:38:15 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Volume volume-45defce6-ca3a-4372-ab75-23a77a7e5fe7 (45defce6-ca3a-4372-ab75-23a77a7e5fe7): created successfully Sep 05 11:38:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (888e20b6-fe0b-4b2a-958c-184c10c621a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:38:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Flow 'volume_create_manager' (bf69eb99-a0a0-4762-9664-7d8cdf993f9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:38:15 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-8cf7d0c5-91ff-4da6-ba03-3d64ec95223f tempest-ServerActionsTestOtherA-1878425266 None] Created volume successfully. Sep 05 11:38:15 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d6e4372-b251-41e1-872d-5024221dfa2a tempest-SnapshotsActionsTest-790885362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.830eb289-e535-435d-95a7-e8d8f41ce062" returned: 0 in 0.328s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d6e4372-b251-41e1-872d-5024221dfa2a tempest-SnapshotsActionsTest-790885362 None] Lock "cinder-quobyte-830eb289-e535-435d-95a7-e8d8f41ce062" released by "_delete_snapshot" :: held 2.016s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:38:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d6e4372-b251-41e1-872d-5024221dfa2a tempest-SnapshotsActionsTest-790885362 None] Lock "cinder-quobyte-6a620629-1351-4eda-b66d-14edb23fb6cb" released by "delete_snapshot" :: held 2.053s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:38:15 devstack sudo[94452]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-019ef21d-1131-4d48-bc01-8a881a657670 1073741824" returned: 0 in 0.615s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-019ef21d-1131-4d48-bc01-8a881a657670 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:15 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-1d6e4372-b251-41e1-872d-5024221dfa2a tempest-SnapshotsActionsTest-790885362 None] Created reservations ['b7a44928-2686-494f-b062-e3c41439cb09', 'dc033ed2-f26e-46bb-8104-3581d1059760', 'da5e496a-7122-47fd-8b53-db1929a1edb6', 'c463f1f9-6e8b-4ef1-8c87-597365878bc1'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:38:15 devstack sudo[94467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-019ef21d-1131-4d48-bc01-8a881a657670 Sep 05 11:38:15 devstack sudo[94467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:15 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-1d6e4372-b251-41e1-872d-5024221dfa2a tempest-SnapshotsActionsTest-790885362 None] Delete snapshot completed successfully. Sep 05 11:38:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d6e4372-b251-41e1-872d-5024221dfa2a tempest-SnapshotsActionsTest-790885362 None] Lock "cinder-830eb289-e535-435d-95a7-e8d8f41ce062-delete_snapshot" released by "delete_snapshot" :: held 2.279s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:38:15 devstack sudo[94467]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-019ef21d-1131-4d48-bc01-8a881a657670" returned: 0 in 0.348s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:38:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:38:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d78a69d-626f-482a-ba82-3de42a3cc8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-019ef21d-1131-4d48-bc01-8a881a657670', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:38:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18e70a47-ab23-40ef-aa5c-053b214f69fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:38:15 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] Volume volume-019ef21d-1131-4d48-bc01-8a881a657670 (019ef21d-1131-4d48-bc01-8a881a657670): created successfully Sep 05 11:38:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18e70a47-ab23-40ef-aa5c-053b214f69fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:38:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] Flow 'volume_create_manager' (2d6549db-715a-4282-ae55-15bcad4a90b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:38:15 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-baf7b75d-35ce-40f0-a18d-8c15e329c608 tempest-AttachVolumeNegativeTest-57248058 None] Created volume successfully. Sep 05 11:38:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e5c86949-3a3f-404b-be0e-3a4913ead988 tempest-SnapshotsActionsTest-298787723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:38:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e5c86949-3a3f-404b-be0e-3a4913ead988 tempest-SnapshotsActionsTest-298787723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:38:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-e5c86949-3a3f-404b-be0e-3a4913ead988 tempest-SnapshotsActionsTest-298787723 None] Creating offline snapshot 88b7998e-905f-4040-b75d-a818af67a7d5 of volume 6a620629-1351-4eda-b66d-14edb23fb6cb {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:38:17 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f1d3b6-fe5c-4e5e-ac58-9a88274963e2]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:38:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e5c86949-3a3f-404b-be0e-3a4913ead988 tempest-SnapshotsActionsTest-298787723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:17 devstack sudo[94476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e Sep 05 11:38:17 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:17 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e5c86949-3a3f-404b-be0e-3a4913ead988 tempest-SnapshotsActionsTest-298787723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e" returned: 0 in 0.633s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-e5c86949-3a3f-404b-be0e-3a4913ead988 tempest-SnapshotsActionsTest-298787723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a620629-1351-4eda-b66d-14edb23fb6cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:38:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e5c86949-3a3f-404b-be0e-3a4913ead988 tempest-SnapshotsActionsTest-298787723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.88b7998e-905f-4040-b75d-a818af67a7d5 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:17 devstack sudo[94482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.88b7998e-905f-4040-b75d-a818af67a7d5 1G Sep 05 11:38:17 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-014f1c93-a16c-4216-a049-0d062f2ac12d req-fcf57f1b-b929-4d4d-af73-b82d80e7a753 tempest-AttachVolumeNegativeTest-57248058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:38:18 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e5c86949-3a3f-404b-be0e-3a4913ead988 tempest-SnapshotsActionsTest-298787723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.88b7998e-905f-4040-b75d-a818af67a7d5 1G" returned: 0 in 0.673s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e5c86949-3a3f-404b-be0e-3a4913ead988 tempest-SnapshotsActionsTest-298787723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.88b7998e-905f-4040-b75d-a818af67a7d5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:18 devstack sudo[94500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.88b7998e-905f-4040-b75d-a818af67a7d5 Sep 05 11:38:18 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:18 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e5c86949-3a3f-404b-be0e-3a4913ead988 tempest-SnapshotsActionsTest-298787723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.88b7998e-905f-4040-b75d-a818af67a7d5" returned: 0 in 0.401s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:18 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-e5c86949-3a3f-404b-be0e-3a4913ead988 tempest-SnapshotsActionsTest-298787723 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.88b7998e-905f-4040-b75d-a818af67a7d5 is being set with open permissions: ugo+rw Sep 05 11:38:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e5c86949-3a3f-404b-be0e-3a4913ead988 tempest-SnapshotsActionsTest-298787723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.88b7998e-905f-4040-b75d-a818af67a7d5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:19 devstack sudo[94505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.88b7998e-905f-4040-b75d-a818af67a7d5 Sep 05 11:38:19 devstack sudo[94505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:19 devstack sudo[94505]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e5c86949-3a3f-404b-be0e-3a4913ead988 tempest-SnapshotsActionsTest-298787723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.88b7998e-905f-4040-b75d-a818af67a7d5" returned: 0 in 0.338s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e5c86949-3a3f-404b-be0e-3a4913ead988 tempest-SnapshotsActionsTest-298787723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.339s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:38:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-014f1c93-a16c-4216-a049-0d062f2ac12d req-fcf57f1b-b929-4d4d-af73-b82d80e7a753 tempest-AttachVolumeNegativeTest-57248058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.930s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:38:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-014f1c93-a16c-4216-a049-0d062f2ac12d req-fcf57f1b-b929-4d4d-af73-b82d80e7a753 tempest-AttachVolumeNegativeTest-57248058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:38:19 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e5c86949-3a3f-404b-be0e-3a4913ead988 tempest-SnapshotsActionsTest-298787723 None] Create snapshot completed successfully Sep 05 11:38:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-014f1c93-a16c-4216-a049-0d062f2ac12d req-fcf57f1b-b929-4d4d-af73-b82d80e7a753 tempest-AttachVolumeNegativeTest-57248058 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32', 'name': 'volume-019ef21d-1131-4d48-bc01-8a881a657670', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '51d571ed-300d-4830-a1d5-cc0d87d71bb2', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 11:38:19 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-014f1c93-a16c-4216-a049-0d062f2ac12d req-fcf57f1b-b929-4d4d-af73-b82d80e7a753 tempest-AttachVolumeNegativeTest-57248058 None] attachment_update completed successfully. Sep 05 11:38:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-59797a63-11ee-4246-82f2-ff5ebd250ba7 req-4ac73df2-78c6-4841-ad56-15f9efe374b8 tempest-ServerActionsTestOtherA-1878425266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:38:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-59797a63-11ee-4246-82f2-ff5ebd250ba7 req-4ac73df2-78c6-4841-ad56-15f9efe374b8 tempest-ServerActionsTestOtherA-1878425266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:38:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-59797a63-11ee-4246-82f2-ff5ebd250ba7 req-4ac73df2-78c6-4841-ad56-15f9efe374b8 tempest-ServerActionsTestOtherA-1878425266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:38:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-59797a63-11ee-4246-82f2-ff5ebd250ba7 req-4ac73df2-78c6-4841-ad56-15f9efe374b8 tempest-ServerActionsTestOtherA-1878425266 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32', 'name': 'volume-45defce6-ca3a-4372-ab75-23a77a7e5fe7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0a939d1c-112c-4d15-b0af-afafdb5713ef', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 11:38:19 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-59797a63-11ee-4246-82f2-ff5ebd250ba7 req-4ac73df2-78c6-4841-ad56-15f9efe374b8 tempest-ServerActionsTestOtherA-1878425266 None] attachment_update completed successfully. Sep 05 11:38:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4b7a3a8d-dd29-46a2-9269-0e0f39f4ffe4 tempest-SnapshotsActionsTest-790885362 None] Acquiring lock "cinder-88b7998e-905f-4040-b75d-a818af67a7d5-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:38:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4b7a3a8d-dd29-46a2-9269-0e0f39f4ffe4 tempest-SnapshotsActionsTest-790885362 None] Lock "cinder-88b7998e-905f-4040-b75d-a818af67a7d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:38:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4b7a3a8d-dd29-46a2-9269-0e0f39f4ffe4 tempest-SnapshotsActionsTest-790885362 None] Acquiring lock "cinder-quobyte-6a620629-1351-4eda-b66d-14edb23fb6cb" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:38:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4b7a3a8d-dd29-46a2-9269-0e0f39f4ffe4 tempest-SnapshotsActionsTest-790885362 None] Lock "cinder-quobyte-6a620629-1351-4eda-b66d-14edb23fb6cb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:38:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4b7a3a8d-dd29-46a2-9269-0e0f39f4ffe4 tempest-SnapshotsActionsTest-790885362 None] Acquiring lock "cinder-quobyte-88b7998e-905f-4040-b75d-a818af67a7d5" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:38:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4b7a3a8d-dd29-46a2-9269-0e0f39f4ffe4 tempest-SnapshotsActionsTest-790885362 None] Lock "cinder-quobyte-88b7998e-905f-4040-b75d-a818af67a7d5" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:38:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-4b7a3a8d-dd29-46a2-9269-0e0f39f4ffe4 tempest-SnapshotsActionsTest-790885362 None] Deleting offline snapshot 88b7998e-905f-4040-b75d-a818af67a7d5 of volume 6a620629-1351-4eda-b66d-14edb23fb6cb {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:38:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-4b7a3a8d-dd29-46a2-9269-0e0f39f4ffe4 tempest-SnapshotsActionsTest-790885362 None] snapshot_file for this snap is: volume-6a620629-1351-4eda-b66d-14edb23fb6cb.88b7998e-905f-4040-b75d-a818af67a7d5 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:38:20 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25f1198-5208-4535-9abd-af204c684fe2]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:38:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4b7a3a8d-dd29-46a2-9269-0e0f39f4ffe4 tempest-SnapshotsActionsTest-790885362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.88b7998e-905f-4040-b75d-a818af67a7d5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:20 devstack sudo[94898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.88b7998e-905f-4040-b75d-a818af67a7d5 Sep 05 11:38:20 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:21 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4b7a3a8d-dd29-46a2-9269-0e0f39f4ffe4 tempest-SnapshotsActionsTest-790885362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.88b7998e-905f-4040-b75d-a818af67a7d5" returned: 0 in 0.435s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-4b7a3a8d-dd29-46a2-9269-0e0f39f4ffe4 tempest-SnapshotsActionsTest-790885362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a620629-1351-4eda-b66d-14edb23fb6cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:38:21 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1f0679-df04-4aa1-b7ac-ff24a1065a07]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:38:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4b7a3a8d-dd29-46a2-9269-0e0f39f4ffe4 tempest-SnapshotsActionsTest-790885362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:21 devstack sudo[94903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e Sep 05 11:38:21 devstack sudo[94903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:21 devstack sudo[94903]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4b7a3a8d-dd29-46a2-9269-0e0f39f4ffe4 tempest-SnapshotsActionsTest-790885362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e" returned: 0 in 0.576s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-4b7a3a8d-dd29-46a2-9269-0e0f39f4ffe4 tempest-SnapshotsActionsTest-790885362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a620629-1351-4eda-b66d-14edb23fb6cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:38:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4b7a3a8d-dd29-46a2-9269-0e0f39f4ffe4 tempest-SnapshotsActionsTest-790885362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.88b7998e-905f-4040-b75d-a818af67a7d5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:21 devstack sudo[94910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.88b7998e-905f-4040-b75d-a818af67a7d5 Sep 05 11:38:21 devstack sudo[94910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:22 devstack sudo[94910]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4b7a3a8d-dd29-46a2-9269-0e0f39f4ffe4 tempest-SnapshotsActionsTest-790885362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.88b7998e-905f-4040-b75d-a818af67a7d5" returned: 0 in 0.628s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4b7a3a8d-dd29-46a2-9269-0e0f39f4ffe4 tempest-SnapshotsActionsTest-790885362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.88b7998e-905f-4040-b75d-a818af67a7d5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:22 devstack sudo[94918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.88b7998e-905f-4040-b75d-a818af67a7d5 Sep 05 11:38:22 devstack sudo[94918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:22 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-94d47ef8-c793-421e-a829-ba7980f6a231 req-4421c3ee-b7a6-44b1-b708-68796e497fba tempest-AttachVolumeNegativeTest-57248058 None] Terminate volume connection completed successfully. Sep 05 11:38:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-94d47ef8-c793-421e-a829-ba7980f6a231 req-4421c3ee-b7a6-44b1-b708-68796e497fba tempest-AttachVolumeNegativeTest-57248058 None] Deleting attachment 51d571ed-300d-4830-a1d5-cc0d87d71bb2. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 11:38:22 devstack sudo[94918]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4b7a3a8d-dd29-46a2-9269-0e0f39f4ffe4 tempest-SnapshotsActionsTest-790885362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.88b7998e-905f-4040-b75d-a818af67a7d5" returned: 0 in 0.467s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4b7a3a8d-dd29-46a2-9269-0e0f39f4ffe4 tempest-SnapshotsActionsTest-790885362 None] Lock "cinder-quobyte-88b7998e-905f-4040-b75d-a818af67a7d5" released by "_delete_snapshot" :: held 2.265s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:38:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4b7a3a8d-dd29-46a2-9269-0e0f39f4ffe4 tempest-SnapshotsActionsTest-790885362 None] Lock "cinder-quobyte-6a620629-1351-4eda-b66d-14edb23fb6cb" released by "delete_snapshot" :: held 2.309s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:38:23 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-4b7a3a8d-dd29-46a2-9269-0e0f39f4ffe4 tempest-SnapshotsActionsTest-790885362 None] Created reservations ['976dbe5e-9654-49be-aac5-de9a02a546f1', 'cf274780-8aeb-4cdc-988b-c9dd7b0ff36d', '4e215a3b-5090-48fa-8ad8-03aaf928d2e9', '199ba2fc-2e89-4087-bac0-f87e1c898d47'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:38:23 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-4b7a3a8d-dd29-46a2-9269-0e0f39f4ffe4 tempest-SnapshotsActionsTest-790885362 None] Delete snapshot completed successfully. Sep 05 11:38:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4b7a3a8d-dd29-46a2-9269-0e0f39f4ffe4 tempest-SnapshotsActionsTest-790885362 None] Lock "cinder-88b7998e-905f-4040-b75d-a818af67a7d5-delete_snapshot" released by "delete_snapshot" :: held 2.667s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:38:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0e86279c-6ec1-4ede-bf2f-03c0e47d2e20 tempest-SnapshotsActionsTest-298787723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:38:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0e86279c-6ec1-4ede-bf2f-03c0e47d2e20 tempest-SnapshotsActionsTest-298787723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:38:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-0e86279c-6ec1-4ede-bf2f-03c0e47d2e20 tempest-SnapshotsActionsTest-298787723 None] Creating offline snapshot 30af73c7-7666-4640-9cb9-e1d97361a53c of volume 6a620629-1351-4eda-b66d-14edb23fb6cb {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:38:24 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0241affe-b25d-467b-86c5-5b923f77fdaa]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:38:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0e86279c-6ec1-4ede-bf2f-03c0e47d2e20 tempest-SnapshotsActionsTest-298787723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:24 devstack sudo[95388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e Sep 05 11:38:24 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:25 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0e86279c-6ec1-4ede-bf2f-03c0e47d2e20 tempest-SnapshotsActionsTest-298787723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e" returned: 0 in 0.652s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-0e86279c-6ec1-4ede-bf2f-03c0e47d2e20 tempest-SnapshotsActionsTest-298787723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a620629-1351-4eda-b66d-14edb23fb6cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:38:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0e86279c-6ec1-4ede-bf2f-03c0e47d2e20 tempest-SnapshotsActionsTest-298787723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.30af73c7-7666-4640-9cb9-e1d97361a53c 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:25 devstack sudo[95395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.30af73c7-7666-4640-9cb9-e1d97361a53c 1G Sep 05 11:38:25 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:26 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0e86279c-6ec1-4ede-bf2f-03c0e47d2e20 tempest-SnapshotsActionsTest-298787723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.30af73c7-7666-4640-9cb9-e1d97361a53c 1G" returned: 0 in 0.735s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0e86279c-6ec1-4ede-bf2f-03c0e47d2e20 tempest-SnapshotsActionsTest-298787723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.30af73c7-7666-4640-9cb9-e1d97361a53c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:26 devstack sudo[95401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.30af73c7-7666-4640-9cb9-e1d97361a53c Sep 05 11:38:26 devstack sudo[95401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:26 devstack sudo[95401]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0e86279c-6ec1-4ede-bf2f-03c0e47d2e20 tempest-SnapshotsActionsTest-298787723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.30af73c7-7666-4640-9cb9-e1d97361a53c" returned: 0 in 0.652s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:26 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-0e86279c-6ec1-4ede-bf2f-03c0e47d2e20 tempest-SnapshotsActionsTest-298787723 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.30af73c7-7666-4640-9cb9-e1d97361a53c is being set with open permissions: ugo+rw Sep 05 11:38:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0e86279c-6ec1-4ede-bf2f-03c0e47d2e20 tempest-SnapshotsActionsTest-298787723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.30af73c7-7666-4640-9cb9-e1d97361a53c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:26 devstack sudo[95441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.30af73c7-7666-4640-9cb9-e1d97361a53c Sep 05 11:38:26 devstack sudo[95441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:27 devstack sudo[95441]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0e86279c-6ec1-4ede-bf2f-03c0e47d2e20 tempest-SnapshotsActionsTest-298787723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.30af73c7-7666-4640-9cb9-e1d97361a53c" returned: 0 in 0.567s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0e86279c-6ec1-4ede-bf2f-03c0e47d2e20 tempest-SnapshotsActionsTest-298787723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.763s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:38:27 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-0e86279c-6ec1-4ede-bf2f-03c0e47d2e20 tempest-SnapshotsActionsTest-298787723 None] Create snapshot completed successfully Sep 05 11:38:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0ff1ecad-74b1-40d7-8070-5f04653217e5 tempest-SnapshotsActionsTest-790885362 None] Acquiring lock "cinder-30af73c7-7666-4640-9cb9-e1d97361a53c-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:38:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0ff1ecad-74b1-40d7-8070-5f04653217e5 tempest-SnapshotsActionsTest-790885362 None] Lock "cinder-30af73c7-7666-4640-9cb9-e1d97361a53c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:38:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0ff1ecad-74b1-40d7-8070-5f04653217e5 tempest-SnapshotsActionsTest-790885362 None] Acquiring lock "cinder-quobyte-6a620629-1351-4eda-b66d-14edb23fb6cb" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:38:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0ff1ecad-74b1-40d7-8070-5f04653217e5 tempest-SnapshotsActionsTest-790885362 None] Lock "cinder-quobyte-6a620629-1351-4eda-b66d-14edb23fb6cb" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:38:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0ff1ecad-74b1-40d7-8070-5f04653217e5 tempest-SnapshotsActionsTest-790885362 None] Acquiring lock "cinder-quobyte-30af73c7-7666-4640-9cb9-e1d97361a53c" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:38:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0ff1ecad-74b1-40d7-8070-5f04653217e5 tempest-SnapshotsActionsTest-790885362 None] Lock "cinder-quobyte-30af73c7-7666-4640-9cb9-e1d97361a53c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:38:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-0ff1ecad-74b1-40d7-8070-5f04653217e5 tempest-SnapshotsActionsTest-790885362 None] Deleting offline snapshot 30af73c7-7666-4640-9cb9-e1d97361a53c of volume 6a620629-1351-4eda-b66d-14edb23fb6cb {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:38:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-0ff1ecad-74b1-40d7-8070-5f04653217e5 tempest-SnapshotsActionsTest-790885362 None] snapshot_file for this snap is: volume-6a620629-1351-4eda-b66d-14edb23fb6cb.30af73c7-7666-4640-9cb9-e1d97361a53c {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:38:28 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa414828-d87a-488c-8d71-99e13f83c8f2]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:38:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0ff1ecad-74b1-40d7-8070-5f04653217e5 tempest-SnapshotsActionsTest-790885362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.30af73c7-7666-4640-9cb9-e1d97361a53c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:28 devstack sudo[95448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.30af73c7-7666-4640-9cb9-e1d97361a53c Sep 05 11:38:28 devstack sudo[95448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:28 devstack sudo[95448]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0ff1ecad-74b1-40d7-8070-5f04653217e5 tempest-SnapshotsActionsTest-790885362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.30af73c7-7666-4640-9cb9-e1d97361a53c" returned: 0 in 0.592s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-0ff1ecad-74b1-40d7-8070-5f04653217e5 tempest-SnapshotsActionsTest-790885362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a620629-1351-4eda-b66d-14edb23fb6cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:38:29 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0ff022-ae06-4244-a56e-0517f0b63be4]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:38:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0ff1ecad-74b1-40d7-8070-5f04653217e5 tempest-SnapshotsActionsTest-790885362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:29 devstack sudo[95458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e Sep 05 11:38:29 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:29 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0ff1ecad-74b1-40d7-8070-5f04653217e5 tempest-SnapshotsActionsTest-790885362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e" returned: 0 in 0.684s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-0ff1ecad-74b1-40d7-8070-5f04653217e5 tempest-SnapshotsActionsTest-790885362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a620629-1351-4eda-b66d-14edb23fb6cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:38:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0ff1ecad-74b1-40d7-8070-5f04653217e5 tempest-SnapshotsActionsTest-790885362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.30af73c7-7666-4640-9cb9-e1d97361a53c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:29 devstack sudo[95468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.30af73c7-7666-4640-9cb9-e1d97361a53c Sep 05 11:38:29 devstack sudo[95468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:30 devstack sudo[95468]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0ff1ecad-74b1-40d7-8070-5f04653217e5 tempest-SnapshotsActionsTest-790885362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.30af73c7-7666-4640-9cb9-e1d97361a53c" returned: 0 in 0.831s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0ff1ecad-74b1-40d7-8070-5f04653217e5 tempest-SnapshotsActionsTest-790885362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.30af73c7-7666-4640-9cb9-e1d97361a53c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:30 devstack sudo[95473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.30af73c7-7666-4640-9cb9-e1d97361a53c Sep 05 11:38:30 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:30 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0ff1ecad-74b1-40d7-8070-5f04653217e5 tempest-SnapshotsActionsTest-790885362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.30af73c7-7666-4640-9cb9-e1d97361a53c" returned: 0 in 0.415s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0ff1ecad-74b1-40d7-8070-5f04653217e5 tempest-SnapshotsActionsTest-790885362 None] Lock "cinder-quobyte-30af73c7-7666-4640-9cb9-e1d97361a53c" released by "_delete_snapshot" :: held 2.711s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:38:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0ff1ecad-74b1-40d7-8070-5f04653217e5 tempest-SnapshotsActionsTest-790885362 None] Lock "cinder-quobyte-6a620629-1351-4eda-b66d-14edb23fb6cb" released by "delete_snapshot" :: held 2.752s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:38:31 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-0ff1ecad-74b1-40d7-8070-5f04653217e5 tempest-SnapshotsActionsTest-790885362 None] Created reservations ['d3ffc461-2f60-4115-9b3e-acb78f8f6a4b', '87e34030-0bcc-4a45-92b1-526b9b67f004', 'df8a0993-76ab-4ae5-a9f9-b8b9cc3394c2', '349221f5-0ff1-4b75-b485-9dbbf8117833'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:38:31 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-0ff1ecad-74b1-40d7-8070-5f04653217e5 tempest-SnapshotsActionsTest-790885362 None] Delete snapshot completed successfully. Sep 05 11:38:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0ff1ecad-74b1-40d7-8070-5f04653217e5 tempest-SnapshotsActionsTest-790885362 None] Lock "cinder-30af73c7-7666-4640-9cb9-e1d97361a53c-delete_snapshot" released by "delete_snapshot" :: held 2.978s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:38:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:38:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread count: 28 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 11:38:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread info: [<_MainThread(MainThread, started 131707869511808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 11:38:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fcbe7c29-daa1-4e68-84dc-77388acbbb9f tempest-SnapshotsActionsTest-298787723 None] Acquiring lock "cinder-f8285472-fc32-4a43-a291-102dfe55713e-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:38:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fcbe7c29-daa1-4e68-84dc-77388acbbb9f tempest-SnapshotsActionsTest-298787723 None] Lock "cinder-f8285472-fc32-4a43-a291-102dfe55713e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:38:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fcbe7c29-daa1-4e68-84dc-77388acbbb9f tempest-SnapshotsActionsTest-298787723 None] Acquiring lock "cinder-quobyte-6a620629-1351-4eda-b66d-14edb23fb6cb" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:38:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fcbe7c29-daa1-4e68-84dc-77388acbbb9f tempest-SnapshotsActionsTest-298787723 None] Lock "cinder-quobyte-6a620629-1351-4eda-b66d-14edb23fb6cb" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:38:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fcbe7c29-daa1-4e68-84dc-77388acbbb9f tempest-SnapshotsActionsTest-298787723 None] Acquiring lock "cinder-quobyte-f8285472-fc32-4a43-a291-102dfe55713e" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:38:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fcbe7c29-daa1-4e68-84dc-77388acbbb9f tempest-SnapshotsActionsTest-298787723 None] Lock "cinder-quobyte-f8285472-fc32-4a43-a291-102dfe55713e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:38:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-fcbe7c29-daa1-4e68-84dc-77388acbbb9f tempest-SnapshotsActionsTest-298787723 None] Deleting offline snapshot f8285472-fc32-4a43-a291-102dfe55713e of volume 6a620629-1351-4eda-b66d-14edb23fb6cb {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:38:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-fcbe7c29-daa1-4e68-84dc-77388acbbb9f tempest-SnapshotsActionsTest-298787723 None] snapshot_file for this snap is: volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:38:32 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7149780-870c-44d2-a410-c638b5ada751]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:38:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fcbe7c29-daa1-4e68-84dc-77388acbbb9f tempest-SnapshotsActionsTest-298787723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:32 devstack sudo[95479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e Sep 05 11:38:32 devstack sudo[95479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:33 devstack sudo[95479]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fcbe7c29-daa1-4e68-84dc-77388acbbb9f tempest-SnapshotsActionsTest-298787723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e" returned: 0 in 0.530s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-fcbe7c29-daa1-4e68-84dc-77388acbbb9f tempest-SnapshotsActionsTest-298787723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a620629-1351-4eda-b66d-14edb23fb6cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:38:33 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b125f4-4fca-4c3c-84c1-e7f10872fb41]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:38:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fcbe7c29-daa1-4e68-84dc-77388acbbb9f tempest-SnapshotsActionsTest-298787723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:33 devstack sudo[95485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb Sep 05 11:38:33 devstack sudo[95485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:33 devstack sudo[95485]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fcbe7c29-daa1-4e68-84dc-77388acbbb9f tempest-SnapshotsActionsTest-298787723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb" returned: 0 in 0.621s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fcbe7c29-daa1-4e68-84dc-77388acbbb9f tempest-SnapshotsActionsTest-298787723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:33 devstack sudo[95492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e Sep 05 11:38:33 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:34 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fcbe7c29-daa1-4e68-84dc-77388acbbb9f tempest-SnapshotsActionsTest-298787723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e" returned: 0 in 0.443s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fcbe7c29-daa1-4e68-84dc-77388acbbb9f tempest-SnapshotsActionsTest-298787723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:34 devstack sudo[95498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e Sep 05 11:38:34 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:34 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fcbe7c29-daa1-4e68-84dc-77388acbbb9f tempest-SnapshotsActionsTest-298787723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb.f8285472-fc32-4a43-a291-102dfe55713e" returned: 0 in 0.383s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fcbe7c29-daa1-4e68-84dc-77388acbbb9f tempest-SnapshotsActionsTest-298787723 None] Lock "cinder-quobyte-f8285472-fc32-4a43-a291-102dfe55713e" released by "_delete_snapshot" :: held 2.190s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:38:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fcbe7c29-daa1-4e68-84dc-77388acbbb9f tempest-SnapshotsActionsTest-298787723 None] Lock "cinder-quobyte-6a620629-1351-4eda-b66d-14edb23fb6cb" released by "delete_snapshot" :: held 2.226s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:38:34 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-fcbe7c29-daa1-4e68-84dc-77388acbbb9f tempest-SnapshotsActionsTest-298787723 None] Created reservations ['a324e5cb-48ae-4259-8183-fe2b0bfd7186', '3f82cc17-8160-4007-bb84-91adce587662', 'cd71d694-610a-415f-85b7-92421a28bcd7', '55e149af-b820-40ff-8a77-d81e70f98b12'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:38:34 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-fcbe7c29-daa1-4e68-84dc-77388acbbb9f tempest-SnapshotsActionsTest-298787723 None] Delete snapshot completed successfully. Sep 05 11:38:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fcbe7c29-daa1-4e68-84dc-77388acbbb9f tempest-SnapshotsActionsTest-298787723 None] Lock "cinder-f8285472-fc32-4a43-a291-102dfe55713e-delete_snapshot" released by "delete_snapshot" :: held 2.474s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:38:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9330baf5-be88-41a9-96fc-d9b1f8c57711 tempest-SnapshotsActionsTest-298787723 None] Acquiring lock "cinder-6a620629-1351-4eda-b66d-14edb23fb6cb-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:38:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9330baf5-be88-41a9-96fc-d9b1f8c57711 tempest-SnapshotsActionsTest-298787723 None] Lock "cinder-6a620629-1351-4eda-b66d-14edb23fb6cb-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:38:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9330baf5-be88-41a9-96fc-d9b1f8c57711 tempest-SnapshotsActionsTest-298787723 None] Acquiring lock "cinder-quobyte-6a620629-1351-4eda-b66d-14edb23fb6cb" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:38:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9330baf5-be88-41a9-96fc-d9b1f8c57711 tempest-SnapshotsActionsTest-298787723 None] Lock "cinder-quobyte-6a620629-1351-4eda-b66d-14edb23fb6cb" acquired by "delete_volume" :: waited 0.024s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:38:36 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d07d95-fff3-45bb-a842-34f2ac9caed8]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:38:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9330baf5-be88-41a9-96fc-d9b1f8c57711 tempest-SnapshotsActionsTest-298787723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:36 devstack sudo[95503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb Sep 05 11:38:36 devstack sudo[95503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1382b9c1-b8dc-41f4-9eed-775beb8ad870 tempest-AttachVolumeNegativeTest-57248058 None] Acquiring lock "cinder-019ef21d-1131-4d48-bc01-8a881a657670-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:38:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1382b9c1-b8dc-41f4-9eed-775beb8ad870 tempest-AttachVolumeNegativeTest-57248058 None] Lock "cinder-019ef21d-1131-4d48-bc01-8a881a657670-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:38:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1382b9c1-b8dc-41f4-9eed-775beb8ad870 tempest-AttachVolumeNegativeTest-57248058 None] Acquiring lock "cinder-quobyte-019ef21d-1131-4d48-bc01-8a881a657670" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:38:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1382b9c1-b8dc-41f4-9eed-775beb8ad870 tempest-AttachVolumeNegativeTest-57248058 None] Lock "cinder-quobyte-019ef21d-1131-4d48-bc01-8a881a657670" acquired by "delete_volume" :: waited 0.031s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:38:36 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4eb8af-67cb-4b75-bdd9-714c40dedf73]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:38:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1382b9c1-b8dc-41f4-9eed-775beb8ad870 tempest-AttachVolumeNegativeTest-57248058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-019ef21d-1131-4d48-bc01-8a881a657670 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:36 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-019ef21d-1131-4d48-bc01-8a881a657670 Sep 05 11:38:36 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:37 devstack sudo[95503]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9330baf5-be88-41a9-96fc-d9b1f8c57711 tempest-SnapshotsActionsTest-298787723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb" returned: 0 in 0.937s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9330baf5-be88-41a9-96fc-d9b1f8c57711 tempest-SnapshotsActionsTest-298787723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:37 devstack sudo[95511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb Sep 05 11:38:37 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:37 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1382b9c1-b8dc-41f4-9eed-775beb8ad870 tempest-AttachVolumeNegativeTest-57248058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-019ef21d-1131-4d48-bc01-8a881a657670" returned: 0 in 0.686s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1382b9c1-b8dc-41f4-9eed-775beb8ad870 tempest-AttachVolumeNegativeTest-57248058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-019ef21d-1131-4d48-bc01-8a881a657670 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:37 devstack sudo[95516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-019ef21d-1131-4d48-bc01-8a881a657670 Sep 05 11:38:37 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:37 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9330baf5-be88-41a9-96fc-d9b1f8c57711 tempest-SnapshotsActionsTest-298787723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6a620629-1351-4eda-b66d-14edb23fb6cb" returned: 0 in 0.464s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9330baf5-be88-41a9-96fc-d9b1f8c57711 tempest-SnapshotsActionsTest-298787723 None] Lock "cinder-quobyte-6a620629-1351-4eda-b66d-14edb23fb6cb" released by "delete_volume" :: held 1.547s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:38:37 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-9330baf5-be88-41a9-96fc-d9b1f8c57711 tempest-SnapshotsActionsTest-298787723 None] Created reservations ['48ee3fbe-46ad-424f-afd8-ab918f464919', '124e704e-9513-4439-bb82-1a3b34a11652', '2f73669a-e90c-4cc5-95e8-8096240ef33f', '2eb62a0f-7066-4249-b5e8-2607d836df8c'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:38:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9330baf5-be88-41a9-96fc-d9b1f8c57711 tempest-SnapshotsActionsTest-298787723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:38:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9330baf5-be88-41a9-96fc-d9b1f8c57711 tempest-SnapshotsActionsTest-298787723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:38:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9330baf5-be88-41a9-96fc-d9b1f8c57711 tempest-SnapshotsActionsTest-298787723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:38:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9330baf5-be88-41a9-96fc-d9b1f8c57711 tempest-SnapshotsActionsTest-298787723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:38:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9330baf5-be88-41a9-96fc-d9b1f8c57711 tempest-SnapshotsActionsTest-298787723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:38:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9330baf5-be88-41a9-96fc-d9b1f8c57711 tempest-SnapshotsActionsTest-298787723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:37 devstack sudo[95520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:38:37 devstack sudo[95520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:37 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1382b9c1-b8dc-41f4-9eed-775beb8ad870 tempest-AttachVolumeNegativeTest-57248058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-019ef21d-1131-4d48-bc01-8a881a657670" returned: 0 in 0.638s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1382b9c1-b8dc-41f4-9eed-775beb8ad870 tempest-AttachVolumeNegativeTest-57248058 None] Lock "cinder-quobyte-019ef21d-1131-4d48-bc01-8a881a657670" released by "delete_volume" :: held 1.420s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:38:38 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-1382b9c1-b8dc-41f4-9eed-775beb8ad870 tempest-AttachVolumeNegativeTest-57248058 None] Created reservations ['738f9369-5dbb-4afd-8038-793a15ed0442', '252dace6-8292-4b1b-bbce-38404a029e09', '766a77af-f0b2-4a5d-ba37-e6c276a16ac1', '486b4986-aca8-46e3-a1c2-53763686a08a'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:38:38 devstack sudo[95520]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9330baf5-be88-41a9-96fc-d9b1f8c57711 tempest-SnapshotsActionsTest-298787723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.376s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:38 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-9330baf5-be88-41a9-96fc-d9b1f8c57711 tempest-SnapshotsActionsTest-298787723 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:38:38 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-9330baf5-be88-41a9-96fc-d9b1f8c57711 tempest-SnapshotsActionsTest-298787723 None] Deleted volume successfully. Sep 05 11:38:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9330baf5-be88-41a9-96fc-d9b1f8c57711 tempest-SnapshotsActionsTest-298787723 None] Lock "cinder-6a620629-1351-4eda-b66d-14edb23fb6cb-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:38:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1382b9c1-b8dc-41f4-9eed-775beb8ad870 tempest-AttachVolumeNegativeTest-57248058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:38:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1382b9c1-b8dc-41f4-9eed-775beb8ad870 tempest-AttachVolumeNegativeTest-57248058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:38:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1382b9c1-b8dc-41f4-9eed-775beb8ad870 tempest-AttachVolumeNegativeTest-57248058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:38:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1382b9c1-b8dc-41f4-9eed-775beb8ad870 tempest-AttachVolumeNegativeTest-57248058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:38:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1382b9c1-b8dc-41f4-9eed-775beb8ad870 tempest-AttachVolumeNegativeTest-57248058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:38:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1382b9c1-b8dc-41f4-9eed-775beb8ad870 tempest-AttachVolumeNegativeTest-57248058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:38 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:38:38 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:38 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1382b9c1-b8dc-41f4-9eed-775beb8ad870 tempest-AttachVolumeNegativeTest-57248058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.494s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:38 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-1382b9c1-b8dc-41f4-9eed-775beb8ad870 tempest-AttachVolumeNegativeTest-57248058 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:38:38 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-1382b9c1-b8dc-41f4-9eed-775beb8ad870 tempest-AttachVolumeNegativeTest-57248058 None] Deleted volume successfully. Sep 05 11:38:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1382b9c1-b8dc-41f4-9eed-775beb8ad870 tempest-AttachVolumeNegativeTest-57248058 None] Lock "cinder-019ef21d-1131-4d48-bc01-8a881a657670-delete_volume" released by "delete_volume" :: held 2.469s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:38:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-61618054-99f0-441a-aeb2-8d899203fbef tempest-AttachVolumeNegativeTest-57248058 None] Acquiring lock "cinder-057e07ee-8f3f-444c-a1fc-254530c79940-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:38:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-61618054-99f0-441a-aeb2-8d899203fbef tempest-AttachVolumeNegativeTest-57248058 None] Lock "cinder-057e07ee-8f3f-444c-a1fc-254530c79940-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:38:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-61618054-99f0-441a-aeb2-8d899203fbef tempest-AttachVolumeNegativeTest-57248058 None] Acquiring lock "cinder-quobyte-057e07ee-8f3f-444c-a1fc-254530c79940" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:38:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-61618054-99f0-441a-aeb2-8d899203fbef tempest-AttachVolumeNegativeTest-57248058 None] Lock "cinder-quobyte-057e07ee-8f3f-444c-a1fc-254530c79940" acquired by "delete_volume" :: waited 0.049s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:38:39 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d32ecb-f617-4c0e-8d2e-bbde2f5c7fdf]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:38:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-61618054-99f0-441a-aeb2-8d899203fbef tempest-AttachVolumeNegativeTest-57248058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-057e07ee-8f3f-444c-a1fc-254530c79940 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:39 devstack sudo[95526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-057e07ee-8f3f-444c-a1fc-254530c79940 Sep 05 11:38:39 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:40 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-61618054-99f0-441a-aeb2-8d899203fbef tempest-AttachVolumeNegativeTest-57248058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-057e07ee-8f3f-444c-a1fc-254530c79940" returned: 0 in 0.775s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-61618054-99f0-441a-aeb2-8d899203fbef tempest-AttachVolumeNegativeTest-57248058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-057e07ee-8f3f-444c-a1fc-254530c79940 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:40 devstack sudo[95531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-057e07ee-8f3f-444c-a1fc-254530c79940 Sep 05 11:38:40 devstack sudo[95531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:40 devstack sudo[95531]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-61618054-99f0-441a-aeb2-8d899203fbef tempest-AttachVolumeNegativeTest-57248058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-057e07ee-8f3f-444c-a1fc-254530c79940" returned: 0 in 0.612s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-61618054-99f0-441a-aeb2-8d899203fbef tempest-AttachVolumeNegativeTest-57248058 None] Lock "cinder-quobyte-057e07ee-8f3f-444c-a1fc-254530c79940" released by "delete_volume" :: held 1.469s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:38:40 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-61618054-99f0-441a-aeb2-8d899203fbef tempest-AttachVolumeNegativeTest-57248058 None] Created reservations ['e2748ce6-b94b-4717-9373-e992856c6360', '384acdd6-c63b-4b49-8e04-271a0f438788', '4e950dd3-0542-4658-86c8-be5b8d7ce282', '217b7682-df57-419c-b6a0-6b6372b549cb'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:38:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-61618054-99f0-441a-aeb2-8d899203fbef tempest-AttachVolumeNegativeTest-57248058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:38:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-61618054-99f0-441a-aeb2-8d899203fbef tempest-AttachVolumeNegativeTest-57248058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:38:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-61618054-99f0-441a-aeb2-8d899203fbef tempest-AttachVolumeNegativeTest-57248058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:38:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-61618054-99f0-441a-aeb2-8d899203fbef tempest-AttachVolumeNegativeTest-57248058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:38:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-61618054-99f0-441a-aeb2-8d899203fbef tempest-AttachVolumeNegativeTest-57248058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:38:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-61618054-99f0-441a-aeb2-8d899203fbef tempest-AttachVolumeNegativeTest-57248058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:40 devstack sudo[95537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:38:40 devstack sudo[95537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:41 devstack sudo[95537]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-61618054-99f0-441a-aeb2-8d899203fbef tempest-AttachVolumeNegativeTest-57248058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.422s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:41 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-61618054-99f0-441a-aeb2-8d899203fbef tempest-AttachVolumeNegativeTest-57248058 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:38:41 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-61618054-99f0-441a-aeb2-8d899203fbef tempest-AttachVolumeNegativeTest-57248058 None] Deleted volume successfully. Sep 05 11:38:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-61618054-99f0-441a-aeb2-8d899203fbef tempest-AttachVolumeNegativeTest-57248058 None] Lock "cinder-057e07ee-8f3f-444c-a1fc-254530c79940-delete_volume" released by "delete_volume" :: held 2.376s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:38:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f8899cf3-df99-4f2b-8a8d-8e8965836627 tempest-AttachVolumeNegativeTest-57248058 None] Acquiring lock "cinder-f5902952-6699-456e-8918-608a6811bb26-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:38:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f8899cf3-df99-4f2b-8a8d-8e8965836627 tempest-AttachVolumeNegativeTest-57248058 None] Lock "cinder-f5902952-6699-456e-8918-608a6811bb26-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:38:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f8899cf3-df99-4f2b-8a8d-8e8965836627 tempest-AttachVolumeNegativeTest-57248058 None] Acquiring lock "cinder-quobyte-f5902952-6699-456e-8918-608a6811bb26" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:38:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f8899cf3-df99-4f2b-8a8d-8e8965836627 tempest-AttachVolumeNegativeTest-57248058 None] Lock "cinder-quobyte-f5902952-6699-456e-8918-608a6811bb26" acquired by "delete_volume" :: waited 0.031s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:38:41 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb8f871-3fa5-485b-b9f3-7010889ebbb5]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:38:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f8899cf3-df99-4f2b-8a8d-8e8965836627 tempest-AttachVolumeNegativeTest-57248058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f5902952-6699-456e-8918-608a6811bb26 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:42 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f5902952-6699-456e-8918-608a6811bb26 Sep 05 11:38:42 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:42 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f8899cf3-df99-4f2b-8a8d-8e8965836627 tempest-AttachVolumeNegativeTest-57248058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f5902952-6699-456e-8918-608a6811bb26" returned: 0 in 0.656s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f8899cf3-df99-4f2b-8a8d-8e8965836627 tempest-AttachVolumeNegativeTest-57248058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f5902952-6699-456e-8918-608a6811bb26 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:42 devstack sudo[95551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f5902952-6699-456e-8918-608a6811bb26 Sep 05 11:38:42 devstack sudo[95551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:43 devstack sudo[95551]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f8899cf3-df99-4f2b-8a8d-8e8965836627 tempest-AttachVolumeNegativeTest-57248058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f5902952-6699-456e-8918-608a6811bb26" returned: 0 in 0.443s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f8899cf3-df99-4f2b-8a8d-8e8965836627 tempest-AttachVolumeNegativeTest-57248058 None] Lock "cinder-quobyte-f5902952-6699-456e-8918-608a6811bb26" released by "delete_volume" :: held 1.168s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:38:43 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-f8899cf3-df99-4f2b-8a8d-8e8965836627 tempest-AttachVolumeNegativeTest-57248058 None] Created reservations ['cee04cfc-22e1-4471-8716-4e48a71d083d', '36a72a73-2223-4d1e-9c98-5635367a2a51', '738d71de-9731-4116-a3ec-f577e2c48c16', '08e554ca-abce-4c8b-b49e-aa66acef8046'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:38:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f8899cf3-df99-4f2b-8a8d-8e8965836627 tempest-AttachVolumeNegativeTest-57248058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:38:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f8899cf3-df99-4f2b-8a8d-8e8965836627 tempest-AttachVolumeNegativeTest-57248058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:38:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f8899cf3-df99-4f2b-8a8d-8e8965836627 tempest-AttachVolumeNegativeTest-57248058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:38:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f8899cf3-df99-4f2b-8a8d-8e8965836627 tempest-AttachVolumeNegativeTest-57248058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:38:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f8899cf3-df99-4f2b-8a8d-8e8965836627 tempest-AttachVolumeNegativeTest-57248058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:38:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f8899cf3-df99-4f2b-8a8d-8e8965836627 tempest-AttachVolumeNegativeTest-57248058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:43 devstack sudo[95588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:38:43 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:44 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f8899cf3-df99-4f2b-8a8d-8e8965836627 tempest-AttachVolumeNegativeTest-57248058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.651s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:44 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-f8899cf3-df99-4f2b-8a8d-8e8965836627 tempest-AttachVolumeNegativeTest-57248058 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:38:44 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f8899cf3-df99-4f2b-8a8d-8e8965836627 tempest-AttachVolumeNegativeTest-57248058 None] Deleted volume successfully. Sep 05 11:38:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f8899cf3-df99-4f2b-8a8d-8e8965836627 tempest-AttachVolumeNegativeTest-57248058 None] Lock "cinder-f5902952-6699-456e-8918-608a6811bb26-delete_volume" released by "delete_volume" :: held 2.331s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:38:48 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-c1f73360-aa81-40f9-97a7-8afc0d0d517d req-652ab5f7-d187-4f79-9fa0-4a4cc836eb30 tempest-ServerActionsTestOtherA-1878425266 None] Terminate volume connection completed successfully. Sep 05 11:38:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-c1f73360-aa81-40f9-97a7-8afc0d0d517d req-652ab5f7-d187-4f79-9fa0-4a4cc836eb30 tempest-ServerActionsTestOtherA-1878425266 None] Deleting attachment 0a939d1c-112c-4d15-b0af-afafdb5713ef. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 11:38:49 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:38:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Flow 'volume_create_manager' (9e140605-6575-4638-b475-c67b1db777a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:38:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d35ee084-1aa8-4acc-a005-ba9ac9016478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:38:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d35ee084-1aa8-4acc-a005-ba9ac9016478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-968972230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e07f2cf7-3339-444a-b467-affe67a8a31d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d492b953171a4a72974d2a5df13fc98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:38:49Z,use_quota=True,user_id='f5773cd626114095bc47ccb4a514ec7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:38:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a696d2-a49c-4c32-aefa-0136494fe4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:38:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a696d2-a49c-4c32-aefa-0136494fe4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:38:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (570f5957-e859-4ae8-a982-ac978f080d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:38:49 devstack cinder-volume[87517]: DEBUG cinder.image.glance [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Creating Keystone auth plugin from conf {{(pid=87517) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 11:38:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (570f5957-e859-4ae8-a982-ac978f080d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e07f2cf7-3339-444a-b467-affe67a8a31d', 'volume_name': 'volume-e07f2cf7-3339-444a-b467-affe67a8a31d', 'volume_size': 1, 'image_id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c73a992b4ff1451ca3178925081bf687', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'created_at': datetime.datetime(2026, 9, 5, 9, 26, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 9, 26, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:38:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c11c413c-174c-4274-b3be-3a3ed1d4cbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:38:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c11c413c-174c-4274-b3be-3a3ed1d4cbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:38:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e6c03f8-a8ce-4b28-9053-2d6768f09f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:38:49 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Volume e07f2cf7-3339-444a-b467-affe67a8a31d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e07f2cf7-3339-444a-b467-affe67a8a31d', 'volume_size': 1, 'image_id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c73a992b4ff1451ca3178925081bf687', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'created_at': datetime.datetime(2026, 9, 5, 9, 26, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 9, 26, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 05 11:38:49 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Trying to clone e07f2cf7-3339-444a-b467-affe67a8a31d from image fff52cc1-bd64-4eb0-8735-62bad8dd7741 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'metadata': {}}]). {{(pid=87517) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 11:38:50 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_sr0psb6pdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 11:38:50 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Image download 20.69 MB at 20.69 MB/s Sep 05 11:38:50 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[63147528-9623-4c70-8173-1f36162d7060]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:38:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_sr0psb6pdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:50 devstack sudo[95619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_sr0psb6pdevstack@QuobyteHD Sep 05 11:38:50 devstack sudo[95619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-c1f73360-aa81-40f9-97a7-8afc0d0d517d req-4c7e875f-3466-4744-b7d4-c4d96d537971 tempest-ServerActionsTestOtherA-1878425266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:38:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-c1f73360-aa81-40f9-97a7-8afc0d0d517d req-4c7e875f-3466-4744-b7d4-c4d96d537971 tempest-ServerActionsTestOtherA-1878425266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:38:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-c1f73360-aa81-40f9-97a7-8afc0d0d517d req-4c7e875f-3466-4744-b7d4-c4d96d537971 tempest-ServerActionsTestOtherA-1878425266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:38:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-c1f73360-aa81-40f9-97a7-8afc0d0d517d req-4c7e875f-3466-4744-b7d4-c4d96d537971 tempest-ServerActionsTestOtherA-1878425266 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32', 'name': 'volume-45defce6-ca3a-4372-ab75-23a77a7e5fe7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '39651265-3114-435a-8dd1-b522a8558b3e', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 11:38:50 devstack sudo[95619]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_sr0psb6pdevstack@QuobyteHD" returned: 0 in 0.475s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:50 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Temporary image fff52cc1-bd64-4eb0-8735-62bad8dd7741 is fetched for user f5773cd626114095bc47ccb4a514ec7f. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 11:38:50 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-c1f73360-aa81-40f9-97a7-8afc0d0d517d req-4c7e875f-3466-4744-b7d4-c4d96d537971 tempest-ServerActionsTestOtherA-1878425266 None] attachment_update completed successfully. Sep 05 11:38:51 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[25776c7b-72ec-444f-989d-5ef090e36f64]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:38:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_sr0psb6pdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:51 devstack sudo[95638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_sr0psb6pdevstack@QuobyteHD Sep 05 11:38:51 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:51 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_sr0psb6pdevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:38:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:38:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-968972230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e07f2cf7-3339-444a-b467-affe67a8a31d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d492b953171a4a72974d2a5df13fc98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:38:49Z,use_quota=True,user_id='f5773cd626114095bc47ccb4a514ec7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:38:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Creating volume e07f2cf7-3339-444a-b467-affe67a8a31d {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:38:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:38:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:38:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:38:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:38:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:38:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:38:51 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:38:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e07f2cf7-3339-444a-b467-affe67a8a31d 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:51 devstack sudo[95709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e07f2cf7-3339-444a-b467-affe67a8a31d 1073741824 Sep 05 11:38:51 devstack sudo[95709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:52 devstack sudo[95709]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e07f2cf7-3339-444a-b467-affe67a8a31d 1073741824" returned: 0 in 0.835s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e07f2cf7-3339-444a-b467-affe67a8a31d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:52 devstack sudo[96064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e07f2cf7-3339-444a-b467-affe67a8a31d Sep 05 11:38:52 devstack sudo[96064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:52 devstack sudo[96064]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e07f2cf7-3339-444a-b467-affe67a8a31d" returned: 0 in 0.599s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:52 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:38:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:38:53 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Attempting download of fff52cc1-bd64-4eb0-8735-62bad8dd7741 ((None, [{'url': 'file:///opt/stack/data/glance/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'metadata': {}}])) to volume e07f2cf7-3339-444a-b467-affe67a8a31d. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 11:38:53 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[917cc755-a62f-431f-a98e-e2987fb4341c]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:38:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741_t4scvy1w {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:53 devstack sudo[96074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741_t4scvy1w Sep 05 11:38:53 devstack sudo[96074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:53 devstack sudo[96074]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741_t4scvy1w" returned: 0 in 0.409s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741_t4scvy1w {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:53 devstack sudo[96078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741_t4scvy1w Sep 05 11:38:53 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:54 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741_t4scvy1w" returned: 1 in 0.399s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741_t4scvy1w' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 11:38:54 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33ef870-8bce-477f-af56-85aefb04c910]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:38:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_sr0psb6pdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:54 devstack sudo[96084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_sr0psb6pdevstack@QuobyteHD Sep 05 11:38:54 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:54 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_sr0psb6pdevstack@QuobyteHD" returned: 0 in 0.649s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:54 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] fff52cc1-bd64-4eb0-8735-62bad8dd7741 was qcow2, converting to qcow2 {{(pid=87517) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 11:38:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_sr0psb6pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e07f2cf7-3339-444a-b467-affe67a8a31d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:54 devstack sudo[96090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_sr0psb6pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e07f2cf7-3339-444a-b467-affe67a8a31d Sep 05 11:38:54 devstack sudo[96090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:57 devstack sudo[96090]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_sr0psb6pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e07f2cf7-3339-444a-b467-affe67a8a31d" returned: 0 in 2.948s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:57 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_sr0psb6pdevstack@QuobyteHD, size 112.00 MB, duration 2.95 sec, destination /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e07f2cf7-3339-444a-b467-affe67a8a31d {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 11:38:57 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Converted 112.00 MB image at 37.97 MB/s Sep 05 11:38:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e07f2cf7-3339-444a-b467-affe67a8a31d 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:57 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e07f2cf7-3339-444a-b467-affe67a8a31d 1G Sep 05 11:38:57 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:58 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e07f2cf7-3339-444a-b467-affe67a8a31d 1G" returned: 0 in 0.856s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:58 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Downloaded image fff52cc1-bd64-4eb0-8735-62bad8dd7741 ((None, [{'url': 'file:///opt/stack/data/glance/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'metadata': {}}])) to volume e07f2cf7-3339-444a-b467-affe67a8a31d successfully. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 11:38:58 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Temporary image fff52cc1-bd64-4eb0-8735-62bad8dd7741 for user f5773cd626114095bc47ccb4a514ec7f is deleted. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 11:38:58 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Marking volume e07f2cf7-3339-444a-b467-affe67a8a31d as bootable. {{(pid=87517) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 11:38:58 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Copying metadata from image fff52cc1-bd64-4eb0-8735-62bad8dd7741 to e07f2cf7-3339-444a-b467-affe67a8a31d. {{(pid=87517) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 11:38:58 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Creating volume glance metadata for volume e07f2cf7-3339-444a-b467-affe67a8a31d backed by image fff52cc1-bd64-4eb0-8735-62bad8dd7741 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87517) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 11:38:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e6c03f8-a8ce-4b28-9053-2d6768f09f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e07f2cf7-3339-444a-b467-affe67a8a31d', 'volume_size': 1, 'image_id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c73a992b4ff1451ca3178925081bf687', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'created_at': datetime.datetime(2026, 9, 5, 9, 26, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 9, 26, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:38:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03828a50-807f-4230-8e8e-43d0cf2891d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:38:58 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Volume volume-e07f2cf7-3339-444a-b467-affe67a8a31d (e07f2cf7-3339-444a-b467-affe67a8a31d): created successfully Sep 05 11:38:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03828a50-807f-4230-8e8e-43d0cf2891d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:38:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Flow 'volume_create_manager' (9e140605-6575-4638-b475-c67b1db777a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:38:58 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-690d52be-1afe-40aa-be52-806ac22dd206 tempest-TestShelveInstance-1424890929 None] Created volume successfully. Sep 05 11:38:59 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:38:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] Flow 'volume_create_manager' (539a9a5b-2b7a-4c03-8a21-4f95cd0f231f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:38:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94254f4a-7b90-4981-86ac-070291ef1d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:38:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94254f4a-7b90-4981-86ac-070291ef1d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-201940927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baa3ba9c-af25-467c-a980-2fa5e23801d5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a26f1bcba654426ab1794ad37209e932',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:38:59Z,use_quota=True,user_id='44f06931b7fa4e69b5ff8a06ea316b67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:38:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44334d1f-bf42-4747-9979-9201fec81a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:38:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44334d1f-bf42-4747-9979-9201fec81a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:38:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f7b98b-ce69-4556-8d05-5513ae8af169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:38:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f7b98b-ce69-4556-8d05-5513ae8af169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baa3ba9c-af25-467c-a980-2fa5e23801d5', 'volume_name': 'volume-baa3ba9c-af25-467c-a980-2fa5e23801d5', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:38:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d98b027-a505-402b-82cc-b5bb84837710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:38:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d98b027-a505-402b-82cc-b5bb84837710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:38:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d5b85b-cd5a-41bd-946f-b27dd675bc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:38:59 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] Volume baa3ba9c-af25-467c-a980-2fa5e23801d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baa3ba9c-af25-467c-a980-2fa5e23801d5', 'volume_size': 1} Sep 05 11:38:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:38:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:38:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-201940927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baa3ba9c-af25-467c-a980-2fa5e23801d5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a26f1bcba654426ab1794ad37209e932',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:38:59Z,use_quota=True,user_id='44f06931b7fa4e69b5ff8a06ea316b67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:38:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] Creating volume baa3ba9c-af25-467c-a980-2fa5e23801d5 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:38:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:38:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:38:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:38:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:38:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:38:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:38:59 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:38:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-baa3ba9c-af25-467c-a980-2fa5e23801d5 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:59 devstack sudo[96105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-baa3ba9c-af25-467c-a980-2fa5e23801d5 1073741824 Sep 05 11:38:59 devstack sudo[96105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:38:59 devstack sudo[96105]: pam_unix(sudo:session): session closed for user root Sep 05 11:38:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-baa3ba9c-af25-467c-a980-2fa5e23801d5 1073741824" returned: 0 in 0.658s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:38:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-baa3ba9c-af25-467c-a980-2fa5e23801d5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:38:59 devstack sudo[96111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-baa3ba9c-af25-467c-a980-2fa5e23801d5 Sep 05 11:38:59 devstack sudo[96111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:00 devstack sudo[96111]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-baa3ba9c-af25-467c-a980-2fa5e23801d5" returned: 0 in 0.386s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:39:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:00 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d5b85b-cd5a-41bd-946f-b27dd675bc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baa3ba9c-af25-467c-a980-2fa5e23801d5', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:00 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a692cd-8221-4df4-a2e1-85bfc940716b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:00 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] Volume volume-baa3ba9c-af25-467c-a980-2fa5e23801d5 (baa3ba9c-af25-467c-a980-2fa5e23801d5): created successfully Sep 05 11:39:00 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a692cd-8221-4df4-a2e1-85bfc940716b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:00 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] Flow 'volume_create_manager' (539a9a5b-2b7a-4c03-8a21-4f95cd0f231f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:39:00 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-8561ef8d-3618-4b6f-aa41-def2550ae06e tempest-VolumesTestJSON-1492068772 None] Created volume successfully. Sep 05 11:39:01 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:39:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] Flow 'volume_create_manager' (95fbaabf-1be9-4108-8699-076fabc61a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:39:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ecdc6eb-5933-482d-b718-05ec55aa6965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ecdc6eb-5933-482d-b718-05ec55aa6965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-431679345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada6c85a-1156-4e14-9edd-052f103886ff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a26f1bcba654426ab1794ad37209e932',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:39:02Z,use_quota=True,user_id='44f06931b7fa4e69b5ff8a06ea316b67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb03d581-40ff-4054-a64f-9cc989689e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb03d581-40ff-4054-a64f-9cc989689e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (222e3fa1-15d8-485c-a8cd-c8a43939001f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (222e3fa1-15d8-485c-a8cd-c8a43939001f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ada6c85a-1156-4e14-9edd-052f103886ff', 'volume_name': 'volume-ada6c85a-1156-4e14-9edd-052f103886ff', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a23d0194-0f71-4a75-97a9-1c9926d875ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a23d0194-0f71-4a75-97a9-1c9926d875ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd0ffc47-803f-498e-8e1d-8f560c8c01df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:01 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] Volume ada6c85a-1156-4e14-9edd-052f103886ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ada6c85a-1156-4e14-9edd-052f103886ff', 'volume_size': 1} Sep 05 11:39:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-431679345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada6c85a-1156-4e14-9edd-052f103886ff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a26f1bcba654426ab1794ad37209e932',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:39:02Z,use_quota=True,user_id='44f06931b7fa4e69b5ff8a06ea316b67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:39:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] Creating volume ada6c85a-1156-4e14-9edd-052f103886ff {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:39:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:39:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:39:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:39:01 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:39:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ada6c85a-1156-4e14-9edd-052f103886ff 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:02 devstack sudo[96121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ada6c85a-1156-4e14-9edd-052f103886ff 1073741824 Sep 05 11:39:02 devstack sudo[96121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:02 devstack sudo[96121]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ada6c85a-1156-4e14-9edd-052f103886ff 1073741824" returned: 0 in 0.593s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ada6c85a-1156-4e14-9edd-052f103886ff {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:02 devstack sudo[96127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ada6c85a-1156-4e14-9edd-052f103886ff Sep 05 11:39:02 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:03 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ada6c85a-1156-4e14-9edd-052f103886ff" returned: 0 in 0.391s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:39:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd0ffc47-803f-498e-8e1d-8f560c8c01df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ada6c85a-1156-4e14-9edd-052f103886ff', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25bc543f-e2b9-4ebb-b13b-1e5dea247483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:03 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] Volume volume-ada6c85a-1156-4e14-9edd-052f103886ff (ada6c85a-1156-4e14-9edd-052f103886ff): created successfully Sep 05 11:39:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25bc543f-e2b9-4ebb-b13b-1e5dea247483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] Flow 'volume_create_manager' (95fbaabf-1be9-4108-8699-076fabc61a3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:39:03 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7ebee733-6e40-4dfe-9a7b-21a5d12af4d4 tempest-VolumesTestJSON-1492068772 None] Created volume successfully. Sep 05 11:39:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-5ae57ec8-340d-41ab-a447-81c109c330a2 req-2361272e-f31d-4dd0-af9a-da1fe937c2cc tempest-TestShelveInstance-1424890929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-5ae57ec8-340d-41ab-a447-81c109c330a2 req-2361272e-f31d-4dd0-af9a-da1fe937c2cc tempest-TestShelveInstance-1424890929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-5ae57ec8-340d-41ab-a447-81c109c330a2 req-2361272e-f31d-4dd0-af9a-da1fe937c2cc tempest-TestShelveInstance-1424890929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-5ae57ec8-340d-41ab-a447-81c109c330a2 req-2361272e-f31d-4dd0-af9a-da1fe937c2cc tempest-TestShelveInstance-1424890929 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32', 'name': 'volume-e07f2cf7-3339-444a-b467-affe67a8a31d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '52686804-f8a7-4c44-ab1d-6484bb3a1b7e', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 11:39:03 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-5ae57ec8-340d-41ab-a447-81c109c330a2 req-2361272e-f31d-4dd0-af9a-da1fe937c2cc tempest-TestShelveInstance-1424890929 None] attachment_update completed successfully. Sep 05 11:39:04 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] Flow 'volume_create_manager' (503fd27f-8da2-4aee-b222-7caaf66c3d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbbebea5-8d33-4e1a-920e-7b5740e6638a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbbebea5-8d33-4e1a-920e-7b5740e6638a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1347031491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e6f926-b5da-474e-ae63-52a78a3d7623,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a26f1bcba654426ab1794ad37209e932',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:39:05Z,use_quota=True,user_id='44f06931b7fa4e69b5ff8a06ea316b67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b7a2707-b5e1-47e1-a3e0-746559bde9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b7a2707-b5e1-47e1-a3e0-746559bde9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07afb49f-313a-49f3-be3b-e5ed7b0f5b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07afb49f-313a-49f3-be3b-e5ed7b0f5b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39e6f926-b5da-474e-ae63-52a78a3d7623', 'volume_name': 'volume-39e6f926-b5da-474e-ae63-52a78a3d7623', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69220b42-f300-4955-8450-f5389b1e9743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69220b42-f300-4955-8450-f5389b1e9743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd2d566e-8456-478b-a783-8bfcf6c55a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:05 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] Volume 39e6f926-b5da-474e-ae63-52a78a3d7623: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39e6f926-b5da-474e-ae63-52a78a3d7623', 'volume_size': 1} Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1347031491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e6f926-b5da-474e-ae63-52a78a3d7623,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a26f1bcba654426ab1794ad37209e932',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:39:05Z,use_quota=True,user_id='44f06931b7fa4e69b5ff8a06ea316b67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] Creating volume 39e6f926-b5da-474e-ae63-52a78a3d7623 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:39:05 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-39e6f926-b5da-474e-ae63-52a78a3d7623 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:05 devstack sudo[96138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-39e6f926-b5da-474e-ae63-52a78a3d7623 1073741824 Sep 05 11:39:05 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Flow 'volume_create_manager' (9538be92-5928-4406-869c-9d535fb85946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6237bce6-988e-4984-9830-7d8501a8ede9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6237bce6-988e-4984-9830-7d8501a8ede9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1184634706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5af88aeb-1515-4604-be08-bd4ccca702e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='114600915fe646b6bcb2397169b0e0ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:39:05Z,use_quota=True,user_id='31260c1e554d494895b433a4aef42fd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fa42b12-6e49-4abd-aa4d-b5c4b6965e9b),volume_type_id=7fa42b12-6e49-4abd-aa4d-b5c4b6965e9b)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b69bc2d1-984e-420e-a7e7-5f9815d05733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b69bc2d1-984e-420e-a7e7-5f9815d05733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d71e28c0-b1f5-48fd-9ecb-5ee522bf48d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d71e28c0-b1f5-48fd-9ecb-5ee522bf48d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5af88aeb-1515-4604-be08-bd4ccca702e1', 'volume_name': 'volume-5af88aeb-1515-4604-be08-bd4ccca702e1', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47243112-77fe-4158-96fc-f93f9665f772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47243112-77fe-4158-96fc-f93f9665f772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab5abfac-66bf-4447-a8d5-edfda0b492e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:05 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Volume 5af88aeb-1515-4604-be08-bd4ccca702e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5af88aeb-1515-4604-be08-bd4ccca702e1', 'volume_size': 1} Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:05 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-39e6f926-b5da-474e-ae63-52a78a3d7623 1073741824" returned: 0 in 0.595s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-39e6f926-b5da-474e-ae63-52a78a3d7623 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:05 devstack sudo[96145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-39e6f926-b5da-474e-ae63-52a78a3d7623 Sep 05 11:39:05 devstack sudo[96145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:06 devstack sudo[96145]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-39e6f926-b5da-474e-ae63-52a78a3d7623" returned: 0 in 0.377s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:39:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.673s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1184634706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5af88aeb-1515-4604-be08-bd4ccca702e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='114600915fe646b6bcb2397169b0e0ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:39:05Z,use_quota=True,user_id='31260c1e554d494895b433a4aef42fd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fa42b12-6e49-4abd-aa4d-b5c4b6965e9b),volume_type_id=7fa42b12-6e49-4abd-aa4d-b5c4b6965e9b)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:39:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Creating volume 5af88aeb-1515-4604-be08-bd4ccca702e1 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:39:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:39:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:39:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:39:06 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:39:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5af88aeb-1515-4604-be08-bd4ccca702e1 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd2d566e-8456-478b-a783-8bfcf6c55a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39e6f926-b5da-474e-ae63-52a78a3d7623', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd71860-5599-4128-936a-340ccf15ee8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:06 devstack sudo[96148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5af88aeb-1515-4604-be08-bd4ccca702e1 1073741824 Sep 05 11:39:06 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:06 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] Volume volume-39e6f926-b5da-474e-ae63-52a78a3d7623 (39e6f926-b5da-474e-ae63-52a78a3d7623): created successfully Sep 05 11:39:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd71860-5599-4128-936a-340ccf15ee8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] Flow 'volume_create_manager' (503fd27f-8da2-4aee-b222-7caaf66c3d14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:39:06 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-16054864-9fda-4529-ac87-54a78579fd3c tempest-VolumesTestJSON-1492068772 None] Created volume successfully. Sep 05 11:39:07 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5af88aeb-1515-4604-be08-bd4ccca702e1 1073741824" returned: 0 in 1.073s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5af88aeb-1515-4604-be08-bd4ccca702e1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:07 devstack sudo[96198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5af88aeb-1515-4604-be08-bd4ccca702e1 Sep 05 11:39:07 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:07 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5af88aeb-1515-4604-be08-bd4ccca702e1" returned: 0 in 0.466s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:39:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab5abfac-66bf-4447-a8d5-edfda0b492e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5af88aeb-1515-4604-be08-bd4ccca702e1', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3885d0ba-0e48-4187-b54f-7a6f817a37f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:08 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Volume volume-5af88aeb-1515-4604-be08-bd4ccca702e1 (5af88aeb-1515-4604-be08-bd4ccca702e1): created successfully Sep 05 11:39:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3885d0ba-0e48-4187-b54f-7a6f817a37f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Flow 'volume_create_manager' (9538be92-5928-4406-869c-9d535fb85946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:39:08 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-666fe2c5-b8c9-4cee-a00e-a02a515f5de0 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Created volume successfully. Sep 05 11:39:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ea46a5c3-78c5-468d-b0c1-cef65de96526 tempest-VolumesTestJSON-1492068772 None] Acquiring lock "cinder-39e6f926-b5da-474e-ae63-52a78a3d7623-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:39:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ea46a5c3-78c5-468d-b0c1-cef65de96526 tempest-VolumesTestJSON-1492068772 None] Lock "cinder-39e6f926-b5da-474e-ae63-52a78a3d7623-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:39:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ea46a5c3-78c5-468d-b0c1-cef65de96526 tempest-VolumesTestJSON-1492068772 None] Acquiring lock "cinder-quobyte-39e6f926-b5da-474e-ae63-52a78a3d7623" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:39:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ea46a5c3-78c5-468d-b0c1-cef65de96526 tempest-VolumesTestJSON-1492068772 None] Lock "cinder-quobyte-39e6f926-b5da-474e-ae63-52a78a3d7623" acquired by "delete_volume" :: waited 0.047s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:39:09 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff92554-a76e-40fe-9806-d9e3546033c2]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:39:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ea46a5c3-78c5-468d-b0c1-cef65de96526 tempest-VolumesTestJSON-1492068772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-39e6f926-b5da-474e-ae63-52a78a3d7623 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2a08cb10-3fac-4a68-8799-ce8dec7ea117 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2a08cb10-3fac-4a68-8799-ce8dec7ea117 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2a08cb10-3fac-4a68-8799-ce8dec7ea117 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:39:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2a08cb10-3fac-4a68-8799-ce8dec7ea117 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:39:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2a08cb10-3fac-4a68-8799-ce8dec7ea117 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2a08cb10-3fac-4a68-8799-ce8dec7ea117 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:09 devstack sudo[96225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:39:09 devstack sudo[96225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:09 devstack sudo[96224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-39e6f926-b5da-474e-ae63-52a78a3d7623 Sep 05 11:39:09 devstack sudo[96224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:10 devstack sudo[96225]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2a08cb10-3fac-4a68-8799-ce8dec7ea117 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.311s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:10 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-2a08cb10-3fac-4a68-8799-ce8dec7ea117 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:39:10 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2a08cb10-3fac-4a68-8799-ce8dec7ea117 tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Retype volume completed successfully. Sep 05 11:39:10 devstack sudo[96224]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ea46a5c3-78c5-468d-b0c1-cef65de96526 tempest-VolumesTestJSON-1492068772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-39e6f926-b5da-474e-ae63-52a78a3d7623" returned: 0 in 0.503s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ea46a5c3-78c5-468d-b0c1-cef65de96526 tempest-VolumesTestJSON-1492068772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-39e6f926-b5da-474e-ae63-52a78a3d7623 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:10 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-39e6f926-b5da-474e-ae63-52a78a3d7623 Sep 05 11:39:10 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:10 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ea46a5c3-78c5-468d-b0c1-cef65de96526 tempest-VolumesTestJSON-1492068772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-39e6f926-b5da-474e-ae63-52a78a3d7623" returned: 0 in 0.314s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ea46a5c3-78c5-468d-b0c1-cef65de96526 tempest-VolumesTestJSON-1492068772 None] Lock "cinder-quobyte-39e6f926-b5da-474e-ae63-52a78a3d7623" released by "delete_volume" :: held 0.902s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:39:10 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-ea46a5c3-78c5-468d-b0c1-cef65de96526 tempest-VolumesTestJSON-1492068772 None] Created reservations ['6cf5065b-ec66-404d-95c8-464776bcf294', '22ee4652-dea8-4c9b-94ac-db601e9c3a70', '8ff6d288-2af8-438d-b233-109fc370eb92', 'a93cc205-fa30-43bf-a40c-d258bd379aa4'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:39:10 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=105,cinder:UPDATE=91,cinder:DELETE=10,cinder:INSERT=32 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:39:10 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=117,cinder:INSERT=36,cinder:UPDATE=95,cinder:DELETE=4 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:39:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ea46a5c3-78c5-468d-b0c1-cef65de96526 tempest-VolumesTestJSON-1492068772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ea46a5c3-78c5-468d-b0c1-cef65de96526 tempest-VolumesTestJSON-1492068772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ea46a5c3-78c5-468d-b0c1-cef65de96526 tempest-VolumesTestJSON-1492068772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:39:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ea46a5c3-78c5-468d-b0c1-cef65de96526 tempest-VolumesTestJSON-1492068772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:39:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ea46a5c3-78c5-468d-b0c1-cef65de96526 tempest-VolumesTestJSON-1492068772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ea46a5c3-78c5-468d-b0c1-cef65de96526 tempest-VolumesTestJSON-1492068772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:10 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:39:10 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bd4a1225-85b9-4f10-aaa5-bcbf57e0d5ee tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Acquiring lock "cinder-5af88aeb-1515-4604-be08-bd4ccca702e1-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:39:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bd4a1225-85b9-4f10-aaa5-bcbf57e0d5ee tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Lock "cinder-5af88aeb-1515-4604-be08-bd4ccca702e1-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:39:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bd4a1225-85b9-4f10-aaa5-bcbf57e0d5ee tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Acquiring lock "cinder-quobyte-5af88aeb-1515-4604-be08-bd4ccca702e1" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:39:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bd4a1225-85b9-4f10-aaa5-bcbf57e0d5ee tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Lock "cinder-quobyte-5af88aeb-1515-4604-be08-bd4ccca702e1" acquired by "delete_volume" :: waited 0.025s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:39:11 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0f1094-1de5-4ba4-b778-427f5dcde568]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:39:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bd4a1225-85b9-4f10-aaa5-bcbf57e0d5ee tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5af88aeb-1515-4604-be08-bd4ccca702e1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:11 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ea46a5c3-78c5-468d-b0c1-cef65de96526 tempest-VolumesTestJSON-1492068772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.418s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:11 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-ea46a5c3-78c5-468d-b0c1-cef65de96526 tempest-VolumesTestJSON-1492068772 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:39:11 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ea46a5c3-78c5-468d-b0c1-cef65de96526 tempest-VolumesTestJSON-1492068772 None] Deleted volume successfully. Sep 05 11:39:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ea46a5c3-78c5-468d-b0c1-cef65de96526 tempest-VolumesTestJSON-1492068772 None] Lock "cinder-39e6f926-b5da-474e-ae63-52a78a3d7623-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:39:11 devstack sudo[96242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5af88aeb-1515-4604-be08-bd4ccca702e1 Sep 05 11:39:11 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:11 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bd4a1225-85b9-4f10-aaa5-bcbf57e0d5ee tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5af88aeb-1515-4604-be08-bd4ccca702e1" returned: 0 in 0.463s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bd4a1225-85b9-4f10-aaa5-bcbf57e0d5ee tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5af88aeb-1515-4604-be08-bd4ccca702e1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:11 devstack sudo[96272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5af88aeb-1515-4604-be08-bd4ccca702e1 Sep 05 11:39:11 devstack sudo[96272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ee69dbc5-f1f9-4344-83c7-c2a7b9c1bdde tempest-VolumesTestJSON-1492068772 None] Acquiring lock "cinder-ada6c85a-1156-4e14-9edd-052f103886ff-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:39:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ee69dbc5-f1f9-4344-83c7-c2a7b9c1bdde tempest-VolumesTestJSON-1492068772 None] Lock "cinder-ada6c85a-1156-4e14-9edd-052f103886ff-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:39:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ee69dbc5-f1f9-4344-83c7-c2a7b9c1bdde tempest-VolumesTestJSON-1492068772 None] Acquiring lock "cinder-quobyte-ada6c85a-1156-4e14-9edd-052f103886ff" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:39:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ee69dbc5-f1f9-4344-83c7-c2a7b9c1bdde tempest-VolumesTestJSON-1492068772 None] Lock "cinder-quobyte-ada6c85a-1156-4e14-9edd-052f103886ff" acquired by "delete_volume" :: waited 0.033s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:39:11 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae64a6c7-0f81-479e-9fe5-beaaf8655aeb]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:39:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ee69dbc5-f1f9-4344-83c7-c2a7b9c1bdde tempest-VolumesTestJSON-1492068772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ada6c85a-1156-4e14-9edd-052f103886ff {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:11 devstack sudo[96272]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bd4a1225-85b9-4f10-aaa5-bcbf57e0d5ee tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5af88aeb-1515-4604-be08-bd4ccca702e1" returned: 0 in 0.448s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:11 devstack sudo[96274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ada6c85a-1156-4e14-9edd-052f103886ff Sep 05 11:39:11 devstack sudo[96274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bd4a1225-85b9-4f10-aaa5-bcbf57e0d5ee tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Lock "cinder-quobyte-5af88aeb-1515-4604-be08-bd4ccca702e1" released by "delete_volume" :: held 0.988s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:39:12 devstack cinder-volume[87517]: WARNING cinder.quota [None req-bd4a1225-85b9-4f10-aaa5-bcbf57e0d5ee tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:39:12 devstack cinder-volume[87517]: WARNING cinder.quota [None req-bd4a1225-85b9-4f10-aaa5-bcbf57e0d5ee tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:39:12 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-bd4a1225-85b9-4f10-aaa5-bcbf57e0d5ee tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Created reservations ['6e5c26ea-eb24-4209-b4f4-131b3f9b2ca3', '58c6cb4f-ae35-4eb6-b12b-bac92da3838b', 'a5a7564d-e84a-40cc-ae5d-72d19a0684a4', '1a8b6aa3-cdb8-424b-85bc-42feb281211a'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:39:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bd4a1225-85b9-4f10-aaa5-bcbf57e0d5ee tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bd4a1225-85b9-4f10-aaa5-bcbf57e0d5ee tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bd4a1225-85b9-4f10-aaa5-bcbf57e0d5ee tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:39:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bd4a1225-85b9-4f10-aaa5-bcbf57e0d5ee tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:39:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bd4a1225-85b9-4f10-aaa5-bcbf57e0d5ee tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bd4a1225-85b9-4f10-aaa5-bcbf57e0d5ee tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:12 devstack sudo[96278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:39:12 devstack sudo[96278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:12 devstack sudo[96274]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ee69dbc5-f1f9-4344-83c7-c2a7b9c1bdde tempest-VolumesTestJSON-1492068772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ada6c85a-1156-4e14-9edd-052f103886ff" returned: 0 in 0.574s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ee69dbc5-f1f9-4344-83c7-c2a7b9c1bdde tempest-VolumesTestJSON-1492068772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ada6c85a-1156-4e14-9edd-052f103886ff {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:12 devstack sudo[96283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ada6c85a-1156-4e14-9edd-052f103886ff Sep 05 11:39:12 devstack sudo[96283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:12 devstack sudo[96278]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bd4a1225-85b9-4f10-aaa5-bcbf57e0d5ee tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.343s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:12 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-bd4a1225-85b9-4f10-aaa5-bcbf57e0d5ee tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:39:12 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-bd4a1225-85b9-4f10-aaa5-bcbf57e0d5ee tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Deleted volume successfully. Sep 05 11:39:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bd4a1225-85b9-4f10-aaa5-bcbf57e0d5ee tempest-VolumeRetypeWithoutMigrationTest-2018436310 None] Lock "cinder-5af88aeb-1515-4604-be08-bd4ccca702e1-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:39:12 devstack sudo[96283]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ee69dbc5-f1f9-4344-83c7-c2a7b9c1bdde tempest-VolumesTestJSON-1492068772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ada6c85a-1156-4e14-9edd-052f103886ff" returned: 0 in 0.395s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ee69dbc5-f1f9-4344-83c7-c2a7b9c1bdde tempest-VolumesTestJSON-1492068772 None] Lock "cinder-quobyte-ada6c85a-1156-4e14-9edd-052f103886ff" released by "delete_volume" :: held 1.034s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:39:12 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-ee69dbc5-f1f9-4344-83c7-c2a7b9c1bdde tempest-VolumesTestJSON-1492068772 None] Created reservations ['d0b4b8cd-7a8a-40a5-9a68-8cb47022fff4', 'f18084c7-e392-4e24-a57f-16f04893e065', 'ae6b0b3f-52fb-44df-a616-9f88a9112b3a', '135cd33b-50f1-497f-826a-9e93441b00a9'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:39:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ee69dbc5-f1f9-4344-83c7-c2a7b9c1bdde tempest-VolumesTestJSON-1492068772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ee69dbc5-f1f9-4344-83c7-c2a7b9c1bdde tempest-VolumesTestJSON-1492068772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ee69dbc5-f1f9-4344-83c7-c2a7b9c1bdde tempest-VolumesTestJSON-1492068772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:39:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ee69dbc5-f1f9-4344-83c7-c2a7b9c1bdde tempest-VolumesTestJSON-1492068772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:39:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ee69dbc5-f1f9-4344-83c7-c2a7b9c1bdde tempest-VolumesTestJSON-1492068772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ee69dbc5-f1f9-4344-83c7-c2a7b9c1bdde tempest-VolumesTestJSON-1492068772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:13 devstack sudo[96287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:39:13 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:13 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ee69dbc5-f1f9-4344-83c7-c2a7b9c1bdde tempest-VolumesTestJSON-1492068772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.417s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:13 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-ee69dbc5-f1f9-4344-83c7-c2a7b9c1bdde tempest-VolumesTestJSON-1492068772 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:39:13 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ee69dbc5-f1f9-4344-83c7-c2a7b9c1bdde tempest-VolumesTestJSON-1492068772 None] Deleted volume successfully. Sep 05 11:39:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ee69dbc5-f1f9-4344-83c7-c2a7b9c1bdde tempest-VolumesTestJSON-1492068772 None] Lock "cinder-ada6c85a-1156-4e14-9edd-052f103886ff-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:39:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9bbaca6d-6d5f-48f7-8741-439d6ff1aa95 tempest-VolumesTestJSON-1492068772 None] Acquiring lock "cinder-baa3ba9c-af25-467c-a980-2fa5e23801d5-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:39:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9bbaca6d-6d5f-48f7-8741-439d6ff1aa95 tempest-VolumesTestJSON-1492068772 None] Lock "cinder-baa3ba9c-af25-467c-a980-2fa5e23801d5-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:39:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9bbaca6d-6d5f-48f7-8741-439d6ff1aa95 tempest-VolumesTestJSON-1492068772 None] Acquiring lock "cinder-quobyte-baa3ba9c-af25-467c-a980-2fa5e23801d5" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:39:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9bbaca6d-6d5f-48f7-8741-439d6ff1aa95 tempest-VolumesTestJSON-1492068772 None] Lock "cinder-quobyte-baa3ba9c-af25-467c-a980-2fa5e23801d5" acquired by "delete_volume" :: waited 0.031s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:39:14 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbf1045-ea0b-4921-8d80-7613e621df54]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:39:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9bbaca6d-6d5f-48f7-8741-439d6ff1aa95 tempest-VolumesTestJSON-1492068772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-baa3ba9c-af25-467c-a980-2fa5e23801d5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:14 devstack sudo[96291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-baa3ba9c-af25-467c-a980-2fa5e23801d5 Sep 05 11:39:14 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:14 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9bbaca6d-6d5f-48f7-8741-439d6ff1aa95 tempest-VolumesTestJSON-1492068772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-baa3ba9c-af25-467c-a980-2fa5e23801d5" returned: 0 in 0.563s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9bbaca6d-6d5f-48f7-8741-439d6ff1aa95 tempest-VolumesTestJSON-1492068772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-baa3ba9c-af25-467c-a980-2fa5e23801d5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:14 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-baa3ba9c-af25-467c-a980-2fa5e23801d5 Sep 05 11:39:14 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:15 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9bbaca6d-6d5f-48f7-8741-439d6ff1aa95 tempest-VolumesTestJSON-1492068772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-baa3ba9c-af25-467c-a980-2fa5e23801d5" returned: 0 in 0.304s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9bbaca6d-6d5f-48f7-8741-439d6ff1aa95 tempest-VolumesTestJSON-1492068772 None] Lock "cinder-quobyte-baa3ba9c-af25-467c-a980-2fa5e23801d5" released by "delete_volume" :: held 0.938s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:39:15 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-9bbaca6d-6d5f-48f7-8741-439d6ff1aa95 tempest-VolumesTestJSON-1492068772 None] Created reservations ['8cb94e34-fafa-4dc3-af1d-b7b3d5fc571c', '6f4e3bfd-0f72-4ec1-9035-09407a7003af', '3279a344-1f9f-405b-97cf-2169e7fc6389', '0fcb3587-71ea-4a94-b9bd-a7e86000ea7f'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:39:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9bbaca6d-6d5f-48f7-8741-439d6ff1aa95 tempest-VolumesTestJSON-1492068772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9bbaca6d-6d5f-48f7-8741-439d6ff1aa95 tempest-VolumesTestJSON-1492068772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9bbaca6d-6d5f-48f7-8741-439d6ff1aa95 tempest-VolumesTestJSON-1492068772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:39:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9bbaca6d-6d5f-48f7-8741-439d6ff1aa95 tempest-VolumesTestJSON-1492068772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:39:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9bbaca6d-6d5f-48f7-8741-439d6ff1aa95 tempest-VolumesTestJSON-1492068772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9bbaca6d-6d5f-48f7-8741-439d6ff1aa95 tempest-VolumesTestJSON-1492068772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:15 devstack sudo[96300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:39:15 devstack sudo[96300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:15 devstack sudo[96300]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9bbaca6d-6d5f-48f7-8741-439d6ff1aa95 tempest-VolumesTestJSON-1492068772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.360s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:15 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-9bbaca6d-6d5f-48f7-8741-439d6ff1aa95 tempest-VolumesTestJSON-1492068772 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:39:15 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-9bbaca6d-6d5f-48f7-8741-439d6ff1aa95 tempest-VolumesTestJSON-1492068772 None] Deleted volume successfully. Sep 05 11:39:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9bbaca6d-6d5f-48f7-8741-439d6ff1aa95 tempest-VolumesTestJSON-1492068772 None] Lock "cinder-baa3ba9c-af25-467c-a980-2fa5e23801d5-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:39:23 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:39:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] Flow 'volume_create_manager' (6f439b44-fe43-473c-bffb-bd90a788302e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:39:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17df91df-b47e-45f2-8ab9-eb89800a2fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17df91df-b47e-45f2-8ab9-eb89800a2fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2068234160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11179218-d9a5-4b5b-8f33-b1c66c00c54c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13b4f927b7d448bfb2ddd9bad896bb0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:39:23Z,use_quota=True,user_id='c054d0f0a8f142cba00650d5c50cf4dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8bfd5b0-c508-4114-bd13-1d37d59787de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8bfd5b0-c508-4114-bd13-1d37d59787de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (213f4135-7481-4d5e-aab5-92a698eb589f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (213f4135-7481-4d5e-aab5-92a698eb589f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11179218-d9a5-4b5b-8f33-b1c66c00c54c', 'volume_name': 'volume-11179218-d9a5-4b5b-8f33-b1c66c00c54c', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ea42837-6eb0-424e-a767-b00624395a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ea42837-6eb0-424e-a767-b00624395a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86fade95-a926-4173-9c8b-45bf900ae760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:23 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] Volume 11179218-d9a5-4b5b-8f33-b1c66c00c54c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11179218-d9a5-4b5b-8f33-b1c66c00c54c', 'volume_size': 1} Sep 05 11:39:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2068234160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11179218-d9a5-4b5b-8f33-b1c66c00c54c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13b4f927b7d448bfb2ddd9bad896bb0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:39:23Z,use_quota=True,user_id='c054d0f0a8f142cba00650d5c50cf4dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:39:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] Creating volume 11179218-d9a5-4b5b-8f33-b1c66c00c54c {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:39:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:39:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:39:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:39:23 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:39:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-11179218-d9a5-4b5b-8f33-b1c66c00c54c 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:23 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-aa11f48d-0f44-4319-96e0-556b84c00d04 req-abf96e51-f966-48fd-9cff-f3f79f2f4ffc tempest-ServerActionsTestOtherA-1878425266 None] Terminate volume connection completed successfully. Sep 05 11:39:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-aa11f48d-0f44-4319-96e0-556b84c00d04 req-abf96e51-f966-48fd-9cff-f3f79f2f4ffc tempest-ServerActionsTestOtherA-1878425266 None] Deleting attachment 39651265-3114-435a-8dd1-b522a8558b3e. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 11:39:23 devstack sudo[96353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-11179218-d9a5-4b5b-8f33-b1c66c00c54c 1073741824 Sep 05 11:39:23 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:23 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-383a6e40-7b38-414c-a4c6-0afafc684630 tempest-GroupSnapshotsTest-1329754185 None] Group tempest-GroupSnapshotsTest-Group-1134259620: creating Sep 05 11:39:23 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-383a6e40-7b38-414c-a4c6-0afafc684630 tempest-GroupSnapshotsTest-1329754185 None] Group tempest-GroupSnapshotsTest-Group-1134259620: created successfully Sep 05 11:39:23 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-383a6e40-7b38-414c-a4c6-0afafc684630 tempest-GroupSnapshotsTest-1329754185 None] Create group completed successfully. Sep 05 11:39:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-aa11f48d-0f44-4319-96e0-556b84c00d04 req-be85e18e-8599-442b-969d-cccb6914db83 tempest-ServerActionsTestOtherA-1878425266 None] Acquiring lock "cinder-45defce6-ca3a-4372-ab75-23a77a7e5fe7-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:39:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-aa11f48d-0f44-4319-96e0-556b84c00d04 req-be85e18e-8599-442b-969d-cccb6914db83 tempest-ServerActionsTestOtherA-1878425266 None] Lock "cinder-45defce6-ca3a-4372-ab75-23a77a7e5fe7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:39:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-aa11f48d-0f44-4319-96e0-556b84c00d04 req-be85e18e-8599-442b-969d-cccb6914db83 tempest-ServerActionsTestOtherA-1878425266 None] Acquiring lock "cinder-quobyte-45defce6-ca3a-4372-ab75-23a77a7e5fe7" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:39:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-aa11f48d-0f44-4319-96e0-556b84c00d04 req-be85e18e-8599-442b-969d-cccb6914db83 tempest-ServerActionsTestOtherA-1878425266 None] Lock "cinder-quobyte-45defce6-ca3a-4372-ab75-23a77a7e5fe7" acquired by "delete_volume" :: waited 0.038s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:39:24 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[88922470-278a-4ab1-a728-142b938c9d77]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:39:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-aa11f48d-0f44-4319-96e0-556b84c00d04 req-be85e18e-8599-442b-969d-cccb6914db83 tempest-ServerActionsTestOtherA-1878425266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-45defce6-ca3a-4372-ab75-23a77a7e5fe7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:24 devstack sudo[96358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-45defce6-ca3a-4372-ab75-23a77a7e5fe7 Sep 05 11:39:24 devstack sudo[96358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:24 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-11179218-d9a5-4b5b-8f33-b1c66c00c54c 1073741824" returned: 0 in 0.654s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-11179218-d9a5-4b5b-8f33-b1c66c00c54c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:24 devstack sudo[96363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-11179218-d9a5-4b5b-8f33-b1c66c00c54c Sep 05 11:39:24 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:24 devstack sudo[96358]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-aa11f48d-0f44-4319-96e0-556b84c00d04 req-be85e18e-8599-442b-969d-cccb6914db83 tempest-ServerActionsTestOtherA-1878425266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-45defce6-ca3a-4372-ab75-23a77a7e5fe7" returned: 0 in 0.511s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-aa11f48d-0f44-4319-96e0-556b84c00d04 req-be85e18e-8599-442b-969d-cccb6914db83 tempest-ServerActionsTestOtherA-1878425266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-45defce6-ca3a-4372-ab75-23a77a7e5fe7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:24 devstack sudo[96369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-45defce6-ca3a-4372-ab75-23a77a7e5fe7 Sep 05 11:39:24 devstack sudo[96369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:24 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-11179218-d9a5-4b5b-8f33-b1c66c00c54c" returned: 0 in 0.344s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:39:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86fade95-a926-4173-9c8b-45bf900ae760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11179218-d9a5-4b5b-8f33-b1c66c00c54c', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ef7cc14-5adf-4a05-a2bd-9606186448a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:24 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] Volume volume-11179218-d9a5-4b5b-8f33-b1c66c00c54c (11179218-d9a5-4b5b-8f33-b1c66c00c54c): created successfully Sep 05 11:39:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ef7cc14-5adf-4a05-a2bd-9606186448a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] Flow 'volume_create_manager' (6f439b44-fe43-473c-bffb-bd90a788302e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:39:24 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-78934d77-242f-4658-89a0-f4cfd623b75b tempest-VolumesServicesTestJSON-1543014543 None] Created volume successfully. Sep 05 11:39:24 devstack sudo[96369]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-aa11f48d-0f44-4319-96e0-556b84c00d04 req-be85e18e-8599-442b-969d-cccb6914db83 tempest-ServerActionsTestOtherA-1878425266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-45defce6-ca3a-4372-ab75-23a77a7e5fe7" returned: 0 in 0.340s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-aa11f48d-0f44-4319-96e0-556b84c00d04 req-be85e18e-8599-442b-969d-cccb6914db83 tempest-ServerActionsTestOtherA-1878425266 None] Lock "cinder-quobyte-45defce6-ca3a-4372-ab75-23a77a7e5fe7" released by "delete_volume" :: held 0.912s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-231d4e6a-5a83-4bc9-88c8-949b4e39edb8 tempest-ServerActionsTestOtherA-1878425266 None] Acquiring lock "cinder-316b4a8e-57e9-44a1-be4f-c7ff249279c4-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-231d4e6a-5a83-4bc9-88c8-949b4e39edb8 tempest-ServerActionsTestOtherA-1878425266 None] Lock "cinder-316b4a8e-57e9-44a1-be4f-c7ff249279c4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG cinder.quota [req-aa11f48d-0f44-4319-96e0-556b84c00d04 req-be85e18e-8599-442b-969d-cccb6914db83 tempest-ServerActionsTestOtherA-1878425266 None] Created reservations ['398b87ec-870f-4256-9c60-329470f3534d', '65753b79-ce06-4feb-a280-ee7149b3b07b', '78ea127e-22d1-4c8c-b894-477d920c0e8c', 'b21f0b81-4e11-45b8-922e-436557889625'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-231d4e6a-5a83-4bc9-88c8-949b4e39edb8 tempest-ServerActionsTestOtherA-1878425266 None] Acquiring lock "cinder-quobyte-316b4a8e-57e9-44a1-be4f-c7ff249279c4" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-aa11f48d-0f44-4319-96e0-556b84c00d04 req-be85e18e-8599-442b-969d-cccb6914db83 tempest-ServerActionsTestOtherA-1878425266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-aa11f48d-0f44-4319-96e0-556b84c00d04 req-be85e18e-8599-442b-969d-cccb6914db83 tempest-ServerActionsTestOtherA-1878425266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-aa11f48d-0f44-4319-96e0-556b84c00d04 req-be85e18e-8599-442b-969d-cccb6914db83 tempest-ServerActionsTestOtherA-1878425266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-aa11f48d-0f44-4319-96e0-556b84c00d04 req-be85e18e-8599-442b-969d-cccb6914db83 tempest-ServerActionsTestOtherA-1878425266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-aa11f48d-0f44-4319-96e0-556b84c00d04 req-be85e18e-8599-442b-969d-cccb6914db83 tempest-ServerActionsTestOtherA-1878425266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-aa11f48d-0f44-4319-96e0-556b84c00d04 req-be85e18e-8599-442b-969d-cccb6914db83 tempest-ServerActionsTestOtherA-1878425266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-231d4e6a-5a83-4bc9-88c8-949b4e39edb8 tempest-ServerActionsTestOtherA-1878425266 None] Lock "cinder-quobyte-316b4a8e-57e9-44a1-be4f-c7ff249279c4" acquired by "delete_volume" :: waited 0.050s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:39:25 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:39:25 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[91778019-adb3-4c04-b578-e75cc4adf09d]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-231d4e6a-5a83-4bc9-88c8-949b4e39edb8 tempest-ServerActionsTestOtherA-1878425266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-316b4a8e-57e9-44a1-be4f-c7ff249279c4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:25 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-316b4a8e-57e9-44a1-be4f-c7ff249279c4 Sep 05 11:39:25 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] Flow 'volume_create_manager' (67e65d8c-6791-40f5-9e74-d32552421a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937bfdbf-1a5e-4d1f-8c61-97181c08831c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937bfdbf-1a5e-4d1f-8c61-97181c08831c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-310999740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=89630ffd-9d96-4f21-b4b8-89a9eaa0bbec,host='devstack@QuobyteHD#QuobyteHD',id=dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4079d39981204503bfd20ba7cc776fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:39:25Z,use_quota=True,user_id='588c3314c4e3499dbe1b69e79f149fdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d412ad09-e76f-4c4a-a0b0-5dc3559119fa),volume_type_id=d412ad09-e76f-4c4a-a0b0-5dc3559119fa)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (315d8ed6-88d4-4ec3-8ba3-b0ae7a54edef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (315d8ed6-88d4-4ec3-8ba3-b0ae7a54edef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:25 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c23e2ad-ab1c-4385-8b55-07a9462a7f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c23e2ad-ab1c-4385-8b55-07a9462a7f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e', 'volume_name': 'volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a541b2e4-270c-413e-a525-be0f3a848f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a541b2e4-270c-413e-a525-be0f3a848f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fab8049b-25aa-4827-8e77-c94f04e88aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:25 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] Volume dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e', 'volume_size': 1} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=89630ffd-9d96-4f21-b4b8-89a9eaa0bbec,created_at=2026-09-05T09:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-310999740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=89630ffd-9d96-4f21-b4b8-89a9eaa0bbec,host='devstack@QuobyteHD#QuobyteHD',id=dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4079d39981204503bfd20ba7cc776fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:39:25Z,use_quota=True,user_id='588c3314c4e3499dbe1b69e79f149fdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d412ad09-e76f-4c4a-a0b0-5dc3559119fa),volume_type_id=d412ad09-e76f-4c4a-a0b0-5dc3559119fa)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] Creating volume dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:39:25 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-aa11f48d-0f44-4319-96e0-556b84c00d04 req-be85e18e-8599-442b-969d-cccb6914db83 tempest-ServerActionsTestOtherA-1878425266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.442s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG cinder.manager [req-aa11f48d-0f44-4319-96e0-556b84c00d04 req-be85e18e-8599-442b-969d-cccb6914db83 tempest-ServerActionsTestOtherA-1878425266 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:39:25 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-aa11f48d-0f44-4319-96e0-556b84c00d04 req-be85e18e-8599-442b-969d-cccb6914db83 tempest-ServerActionsTestOtherA-1878425266 None] Deleted volume successfully. Sep 05 11:39:25 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e 1073741824 Sep 05 11:39:25 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-aa11f48d-0f44-4319-96e0-556b84c00d04 req-be85e18e-8599-442b-969d-cccb6914db83 tempest-ServerActionsTestOtherA-1878425266 None] Lock "cinder-45defce6-ca3a-4372-ab75-23a77a7e5fe7-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:39:25 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-983d40c4-16e1-4de8-951e-5d483555b859 tempest-VolumesServicesTestJSON-1543014543 None] Acquiring lock "cinder-11179218-d9a5-4b5b-8f33-b1c66c00c54c-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-231d4e6a-5a83-4bc9-88c8-949b4e39edb8 tempest-ServerActionsTestOtherA-1878425266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-316b4a8e-57e9-44a1-be4f-c7ff249279c4" returned: 0 in 0.580s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-231d4e6a-5a83-4bc9-88c8-949b4e39edb8 tempest-ServerActionsTestOtherA-1878425266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-316b4a8e-57e9-44a1-be4f-c7ff249279c4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-983d40c4-16e1-4de8-951e-5d483555b859 tempest-VolumesServicesTestJSON-1543014543 None] Lock "cinder-11179218-d9a5-4b5b-8f33-b1c66c00c54c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:39:25 devstack sudo[96384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-316b4a8e-57e9-44a1-be4f-c7ff249279c4 Sep 05 11:39:25 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-983d40c4-16e1-4de8-951e-5d483555b859 tempest-VolumesServicesTestJSON-1543014543 None] Acquiring lock "cinder-quobyte-11179218-d9a5-4b5b-8f33-b1c66c00c54c" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-983d40c4-16e1-4de8-951e-5d483555b859 tempest-VolumesServicesTestJSON-1543014543 None] Lock "cinder-quobyte-11179218-d9a5-4b5b-8f33-b1c66c00c54c" acquired by "delete_volume" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3f81a8-8d65-4f7b-95b4-a1a1ab77ef35]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:39:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-983d40c4-16e1-4de8-951e-5d483555b859 tempest-VolumesServicesTestJSON-1543014543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-11179218-d9a5-4b5b-8f33-b1c66c00c54c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:26 devstack sudo[96386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-11179218-d9a5-4b5b-8f33-b1c66c00c54c Sep 05 11:39:26 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:26 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-231d4e6a-5a83-4bc9-88c8-949b4e39edb8 tempest-ServerActionsTestOtherA-1878425266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-316b4a8e-57e9-44a1-be4f-c7ff249279c4" returned: 0 in 0.422s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-231d4e6a-5a83-4bc9-88c8-949b4e39edb8 tempest-ServerActionsTestOtherA-1878425266 None] Lock "cinder-quobyte-316b4a8e-57e9-44a1-be4f-c7ff249279c4" released by "delete_volume" :: held 1.076s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:39:26 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e 1073741824" returned: 0 in 0.711s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:26 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-231d4e6a-5a83-4bc9-88c8-949b4e39edb8 tempest-ServerActionsTestOtherA-1878425266 None] Created reservations ['847bb3c2-c3ed-4853-bd3a-e4c82c70c987', 'cd3be920-7970-43b5-a1f1-ceb4143cb118', 'b64dae4f-b0c3-40bd-a654-278dbee6ed8f', '8cd17db3-0925-4a97-bf89-6ba53f56760a'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:39:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:26 devstack sudo[96395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e Sep 05 11:39:26 devstack sudo[96395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:26 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-983d40c4-16e1-4de8-951e-5d483555b859 tempest-VolumesServicesTestJSON-1543014543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-11179218-d9a5-4b5b-8f33-b1c66c00c54c" returned: 0 in 0.488s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-983d40c4-16e1-4de8-951e-5d483555b859 tempest-VolumesServicesTestJSON-1543014543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-11179218-d9a5-4b5b-8f33-b1c66c00c54c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:26 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-11179218-d9a5-4b5b-8f33-b1c66c00c54c Sep 05 11:39:26 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-231d4e6a-5a83-4bc9-88c8-949b4e39edb8 tempest-ServerActionsTestOtherA-1878425266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-231d4e6a-5a83-4bc9-88c8-949b4e39edb8 tempest-ServerActionsTestOtherA-1878425266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-231d4e6a-5a83-4bc9-88c8-949b4e39edb8 tempest-ServerActionsTestOtherA-1878425266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:39:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-231d4e6a-5a83-4bc9-88c8-949b4e39edb8 tempest-ServerActionsTestOtherA-1878425266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:39:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-231d4e6a-5a83-4bc9-88c8-949b4e39edb8 tempest-ServerActionsTestOtherA-1878425266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-231d4e6a-5a83-4bc9-88c8-949b4e39edb8 tempest-ServerActionsTestOtherA-1878425266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:26 devstack sudo[96400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:39:26 devstack sudo[96400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:26 devstack sudo[96395]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e" returned: 0 in 0.354s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:39:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:26 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fab8049b-25aa-4827-8e77-c94f04e88aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5982aa21-4170-400d-a067-7d6eb45b67c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-983d40c4-16e1-4de8-951e-5d483555b859 tempest-VolumesServicesTestJSON-1543014543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-11179218-d9a5-4b5b-8f33-b1c66c00c54c" returned: 0 in 0.323s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-983d40c4-16e1-4de8-951e-5d483555b859 tempest-VolumesServicesTestJSON-1543014543 None] Lock "cinder-quobyte-11179218-d9a5-4b5b-8f33-b1c66c00c54c" released by "delete_volume" :: held 0.872s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:39:26 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] Volume volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e (dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e): created successfully Sep 05 11:39:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5982aa21-4170-400d-a067-7d6eb45b67c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] Flow 'volume_create_manager' (67e65d8c-6791-40f5-9e74-d32552421a1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:39:26 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-99b89e88-bd26-430f-ab75-83e41003b239 tempest-GroupSnapshotsTest-1329754185 None] Created volume successfully. Sep 05 11:39:26 devstack sudo[96400]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-231d4e6a-5a83-4bc9-88c8-949b4e39edb8 tempest-ServerActionsTestOtherA-1878425266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.374s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:26 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-231d4e6a-5a83-4bc9-88c8-949b4e39edb8 tempest-ServerActionsTestOtherA-1878425266 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:39:26 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-983d40c4-16e1-4de8-951e-5d483555b859 tempest-VolumesServicesTestJSON-1543014543 None] Created reservations ['991d54dc-e730-4b44-b726-e17cc11b2fb5', '2da5a753-8e7b-4478-b395-e43ddee67b95', 'c6806541-4a04-4a21-aa2d-b9f722596393', '780d9622-ba34-40fa-a532-b30756f8207d'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:39:26 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-231d4e6a-5a83-4bc9-88c8-949b4e39edb8 tempest-ServerActionsTestOtherA-1878425266 None] Deleted volume successfully. Sep 05 11:39:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-231d4e6a-5a83-4bc9-88c8-949b4e39edb8 tempest-ServerActionsTestOtherA-1878425266 None] Lock "cinder-316b4a8e-57e9-44a1-be4f-c7ff249279c4-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:39:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-983d40c4-16e1-4de8-951e-5d483555b859 tempest-VolumesServicesTestJSON-1543014543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-983d40c4-16e1-4de8-951e-5d483555b859 tempest-VolumesServicesTestJSON-1543014543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-983d40c4-16e1-4de8-951e-5d483555b859 tempest-VolumesServicesTestJSON-1543014543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:39:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-983d40c4-16e1-4de8-951e-5d483555b859 tempest-VolumesServicesTestJSON-1543014543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:39:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-983d40c4-16e1-4de8-951e-5d483555b859 tempest-VolumesServicesTestJSON-1543014543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-983d40c4-16e1-4de8-951e-5d483555b859 tempest-VolumesServicesTestJSON-1543014543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:27 devstack sudo[96405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:39:27 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:27 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-983d40c4-16e1-4de8-951e-5d483555b859 tempest-VolumesServicesTestJSON-1543014543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.280s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:27 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-983d40c4-16e1-4de8-951e-5d483555b859 tempest-VolumesServicesTestJSON-1543014543 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:39:27 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-983d40c4-16e1-4de8-951e-5d483555b859 tempest-VolumesServicesTestJSON-1543014543 None] Deleted volume successfully. Sep 05 11:39:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-983d40c4-16e1-4de8-951e-5d483555b859 tempest-VolumesServicesTestJSON-1543014543 None] Lock "cinder-11179218-d9a5-4b5b-8f33-b1c66c00c54c-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:39:28 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-bb883e1a-7304-490b-b224-c24175aeebfd tempest-GroupSnapshotsTest-1329754185 None] GroupSnapshot 1212adfe-a853-42a5-af5b-c904143fba4b: creating. Sep 05 11:39:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bb883e1a-7304-490b-b224-c24175aeebfd tempest-GroupSnapshotsTest-1329754185 None] Group snapshot 1212adfe-a853-42a5-af5b-c904143fba4b: creating. {{(pid=87517) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 05 11:39:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bb883e1a-7304-490b-b224-c24175aeebfd tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bb883e1a-7304-490b-b224-c24175aeebfd tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-bb883e1a-7304-490b-b224-c24175aeebfd tempest-GroupSnapshotsTest-1329754185 None] Creating offline snapshot 10456031-4769-4d67-a466-0cd7ef8de442 of volume dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:39:28 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0a9701-2ff9-4fad-b9ab-34072d461c6f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:39:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bb883e1a-7304-490b-b224-c24175aeebfd tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:28 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e Sep 05 11:39:28 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:29 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bb883e1a-7304-490b-b224-c24175aeebfd tempest-GroupSnapshotsTest-1329754185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e" returned: 0 in 0.473s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bb883e1a-7304-490b-b224-c24175aeebfd tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e.10456031-4769-4d67-a466-0cd7ef8de442 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:29 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e.10456031-4769-4d67-a466-0cd7ef8de442 1G Sep 05 11:39:29 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:29 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bb883e1a-7304-490b-b224-c24175aeebfd tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e.10456031-4769-4d67-a466-0cd7ef8de442 1G" returned: 0 in 0.573s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bb883e1a-7304-490b-b224-c24175aeebfd tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e.10456031-4769-4d67-a466-0cd7ef8de442 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:29 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e.10456031-4769-4d67-a466-0cd7ef8de442 Sep 05 11:39:29 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:30 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bb883e1a-7304-490b-b224-c24175aeebfd tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e.10456031-4769-4d67-a466-0cd7ef8de442" returned: 0 in 0.395s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:30 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-bb883e1a-7304-490b-b224-c24175aeebfd tempest-GroupSnapshotsTest-1329754185 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e.10456031-4769-4d67-a466-0cd7ef8de442 is being set with open permissions: ugo+rw: NotImplementedError Sep 05 11:39:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bb883e1a-7304-490b-b224-c24175aeebfd tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e.10456031-4769-4d67-a466-0cd7ef8de442 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:30 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e.10456031-4769-4d67-a466-0cd7ef8de442 Sep 05 11:39:30 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:30 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bb883e1a-7304-490b-b224-c24175aeebfd tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e.10456031-4769-4d67-a466-0cd7ef8de442" returned: 0 in 0.270s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bb883e1a-7304-490b-b224-c24175aeebfd tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:30 devstack sudo[96491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e.info Sep 05 11:39:30 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:30 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bb883e1a-7304-490b-b224-c24175aeebfd tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e.info" returned: 0 in 0.306s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:30 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-bb883e1a-7304-490b-b224-c24175aeebfd tempest-GroupSnapshotsTest-1329754185 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e.info is being set with open permissions: ugo+rw: NotImplementedError Sep 05 11:39:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bb883e1a-7304-490b-b224-c24175aeebfd tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:30 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e.info Sep 05 11:39:30 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:30 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bb883e1a-7304-490b-b224-c24175aeebfd tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e.info" returned: 0 in 0.311s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bb883e1a-7304-490b-b224-c24175aeebfd tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.436s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:31 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-bb883e1a-7304-490b-b224-c24175aeebfd tempest-GroupSnapshotsTest-1329754185 None] group_snapshot 1212adfe-a853-42a5-af5b-c904143fba4b: created successfully Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:32 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:39:32 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "cinder-quobyte-10456031-4769-4d67-a466-0cd7ef8de442-2f5ed316-09d1-43b1-8ca0-8741a22d891d" by "_create_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] Lock "cinder-quobyte-10456031-4769-4d67-a466-0cd7ef8de442-2f5ed316-09d1-43b1-8ca0-8741a22d891d" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] Creating volume 2f5ed316-09d1-43b1-8ca0-8741a22d891d from snapshot 10456031-4769-4d67-a466-0cd7ef8de442 {{(pid=87517) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "cinder-quobyte-2f5ed316-09d1-43b1-8ca0-8741a22d891d" by "_copy_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:39:32 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.351s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] Lock "cinder-quobyte-2f5ed316-09d1-43b1-8ca0-8741a22d891d" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] snapshot: 10456031-4769-4d67-a466-0cd7ef8de442, volume: 2f5ed316-09d1-43b1-8ca0-8741a22d891d, {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread count: 28 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread info: [<_MainThread(MainThread, started 131707869511808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a59263-614e-4edf-8411-77a6aa1d1d2a]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:39:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e.10456031-4769-4d67-a466-0cd7ef8de442 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:32 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e.10456031-4769-4d67-a466-0cd7ef8de442 Sep 05 11:39:32 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:33 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e.10456031-4769-4d67-a466-0cd7ef8de442" returned: 0 in 0.449s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:39:33 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ea610b-042a-4397-8439-20d2515dd188]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:39:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:33 devstack sudo[96506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e Sep 05 11:39:33 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:33 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e" returned: 0 in 0.447s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 11:39:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] Creating direct copy from snapshot {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 11:39:33 devstack cinder-volume[87517]: DEBUG cinder.utils [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] Path /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f5ed316-09d1-43b1-8ca0-8741a22d891d not found in is_blk_device check {{(pid=87517) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 11:39:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f5ed316-09d1-43b1-8ca0-8741a22d891d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:33 devstack sudo[96512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f5ed316-09d1-43b1-8ca0-8741a22d891d Sep 05 11:39:33 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:36 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:39:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Flow 'volume_create_manager' (9a6e5e17-8467-423f-a22e-1b53ea7dc98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:39:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3586fca5-28f8-4ea5-9a7d-c7afcfcb3771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3586fca5-28f8-4ea5-9a7d-c7afcfcb3771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-730577348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3580f265-e0f4-45a7-81f2-5b4c8161484d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61466c989e494d00bd9f56bd97a2d169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:39:37Z,use_quota=True,user_id='4bd65268c6d64ce2a18473f01d61153c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983ed281-8497-42a7-8b7d-2d58d320988d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983ed281-8497-42a7-8b7d-2d58d320988d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0450a0-adef-465e-ab3e-f1af4d7b2bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0450a0-adef-465e-ab3e-f1af4d7b2bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3580f265-e0f4-45a7-81f2-5b4c8161484d', 'volume_name': 'volume-3580f265-e0f4-45a7-81f2-5b4c8161484d', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f912c010-9d12-4071-b927-a6679c1e2eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f912c010-9d12-4071-b927-a6679c1e2eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10deda40-6b78-4318-bdbf-852ea25b7541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:37 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Volume 3580f265-e0f4-45a7-81f2-5b4c8161484d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3580f265-e0f4-45a7-81f2-5b4c8161484d', 'volume_size': 1} Sep 05 11:39:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f5ed316-09d1-43b1-8ca0-8741a22d891d" returned: 0 in 5.722s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:39 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] Image conversion details: src /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e, size 1024.00 MB, duration 5.72 sec, destination /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f5ed316-09d1-43b1-8ca0-8741a22d891d {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 11:39:39 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] Converted 1024.00 MB image at 178.93 MB/s Sep 05 11:39:39 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f5ed316-09d1-43b1-8ca0-8741a22d891d is being set with open permissions: ugo+rw: NotImplementedError Sep 05 11:39:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f5ed316-09d1-43b1-8ca0-8741a22d891d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:39 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f5ed316-09d1-43b1-8ca0-8741a22d891d Sep 05 11:39:39 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:39 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f5ed316-09d1-43b1-8ca0-8741a22d891d" returned: 0 in 0.290s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] Lock "cinder-quobyte-2f5ed316-09d1-43b1-8ca0-8741a22d891d" released by "_copy_volume_from_snapshot" :: held 7.028s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:39:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] Lock "cinder-quobyte-10456031-4769-4d67-a466-0cd7ef8de442-2f5ed316-09d1-43b1-8ca0-8741a22d891d" released by "_create_volume_from_snapshot" :: held 7.122s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:39:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.152s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.395s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-730577348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3580f265-e0f4-45a7-81f2-5b4c8161484d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61466c989e494d00bd9f56bd97a2d169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:39:37Z,use_quota=True,user_id='4bd65268c6d64ce2a18473f01d61153c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:39:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Creating volume 3580f265-e0f4-45a7-81f2-5b4c8161484d {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:39:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:39:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:39:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:39:39 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:39:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:39 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d 1073741824 Sep 05 11:39:39 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:39 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3e5a82e9-271c-43a1-b94e-415a263c19b6 tempest-GroupSnapshotsTest-1329754185 None] Create group from source-snapshot-1212adfe-a853-42a5-af5b-c904143fba4b completed successfully. Sep 05 11:39:40 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d 1073741824" returned: 0 in 0.509s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:40 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d Sep 05 11:39:40 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-17f3c69f-0481-4603-bf0b-64e5f51a9684 tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "cinder-quobyte-2f5ed316-09d1-43b1-8ca0-8741a22d891d" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:39:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-17f3c69f-0481-4603-bf0b-64e5f51a9684 tempest-GroupSnapshotsTest-1329754185 None] Lock "cinder-quobyte-2f5ed316-09d1-43b1-8ca0-8741a22d891d" acquired by "delete_volume" :: waited 0.024s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:39:40 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bf06d6-fa7f-4e60-bb6c-fc3d6c461305]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:39:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-17f3c69f-0481-4603-bf0b-64e5f51a9684 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f5ed316-09d1-43b1-8ca0-8741a22d891d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:40 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d" returned: 0 in 0.288s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:39:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10deda40-6b78-4318-bdbf-852ea25b7541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3580f265-e0f4-45a7-81f2-5b4c8161484d', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae602216-3cfc-43ee-84be-ef066991d549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:40 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Volume volume-3580f265-e0f4-45a7-81f2-5b4c8161484d (3580f265-e0f4-45a7-81f2-5b4c8161484d): created successfully Sep 05 11:39:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae602216-3cfc-43ee-84be-ef066991d549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Flow 'volume_create_manager' (9a6e5e17-8467-423f-a22e-1b53ea7dc98a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:39:40 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d48c4dfb-773f-44c6-b3ab-c4e7eee00f3c tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Created volume successfully. Sep 05 11:39:40 devstack sudo[96538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f5ed316-09d1-43b1-8ca0-8741a22d891d Sep 05 11:39:40 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:40 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-17f3c69f-0481-4603-bf0b-64e5f51a9684 tempest-GroupSnapshotsTest-1329754185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f5ed316-09d1-43b1-8ca0-8741a22d891d" returned: 0 in 0.406s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-17f3c69f-0481-4603-bf0b-64e5f51a9684 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f5ed316-09d1-43b1-8ca0-8741a22d891d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:40 devstack sudo[96543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f5ed316-09d1-43b1-8ca0-8741a22d891d Sep 05 11:39:40 devstack sudo[96543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:41 devstack sudo[96543]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-17f3c69f-0481-4603-bf0b-64e5f51a9684 tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f5ed316-09d1-43b1-8ca0-8741a22d891d" returned: 0 in 0.260s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-17f3c69f-0481-4603-bf0b-64e5f51a9684 tempest-GroupSnapshotsTest-1329754185 None] Lock "cinder-quobyte-2f5ed316-09d1-43b1-8ca0-8741a22d891d" released by "delete_volume" :: held 0.729s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:39:41 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-17f3c69f-0481-4603-bf0b-64e5f51a9684 tempest-GroupSnapshotsTest-1329754185 None] Created reservations ['b0fc05d7-7631-49ba-af8c-bfc9c9ff2f31'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:39:41 devstack cinder-volume[87517]: WARNING cinder.quota [None req-17f3c69f-0481-4603-bf0b-64e5f51a9684 tempest-GroupSnapshotsTest-1329754185 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1818075072 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1818075072, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:39:41 devstack cinder-volume[87517]: WARNING cinder.quota [None req-17f3c69f-0481-4603-bf0b-64e5f51a9684 tempest-GroupSnapshotsTest-1329754185 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1818075072 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1818075072, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:39:41 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-17f3c69f-0481-4603-bf0b-64e5f51a9684 tempest-GroupSnapshotsTest-1329754185 None] Created reservations ['8909841e-486d-45d8-bcfb-8e6c42568b56', '1357fd05-e60b-4021-bbcb-8c7bf520976e', '9ec2782c-fc11-4d3a-b051-1e4c08c81aa4', '317f1c78-0d34-4ecb-a6c3-0fd31c6b47cf'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:39:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1d902791-45d5-4a96-a539-9e7747dd8367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1d902791-45d5-4a96-a539-9e7747dd8367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-1d902791-45d5-4a96-a539-9e7747dd8367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Creating offline snapshot 33380f05-0ff9-4359-bc46-6ffe4076eee3 of volume 3580f265-e0f4-45a7-81f2-5b4c8161484d {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:39:41 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e83b87-4690-444c-bde7-3c3bb2495add]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:39:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d902791-45d5-4a96-a539-9e7747dd8367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-17f3c69f-0481-4603-bf0b-64e5f51a9684 tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-17f3c69f-0481-4603-bf0b-64e5f51a9684 tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-17f3c69f-0481-4603-bf0b-64e5f51a9684 tempest-GroupSnapshotsTest-1329754185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:39:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-17f3c69f-0481-4603-bf0b-64e5f51a9684 tempest-GroupSnapshotsTest-1329754185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:39:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-17f3c69f-0481-4603-bf0b-64e5f51a9684 tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-17f3c69f-0481-4603-bf0b-64e5f51a9684 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:41 devstack sudo[96548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:39:41 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:41 devstack sudo[96547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d Sep 05 11:39:41 devstack sudo[96547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:41 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-17f3c69f-0481-4603-bf0b-64e5f51a9684 tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.263s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:41 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-17f3c69f-0481-4603-bf0b-64e5f51a9684 tempest-GroupSnapshotsTest-1329754185 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:39:41 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-17f3c69f-0481-4603-bf0b-64e5f51a9684 tempest-GroupSnapshotsTest-1329754185 None] Delete group completed successfully. Sep 05 11:39:41 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-1d588b6a-c7dc-4d93-af87-67a076001735 tempest-GroupSnapshotsTest-1329754185 None] group_snapshot 1212adfe-a853-42a5-af5b-c904143fba4b: deleting Sep 05 11:39:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1d588b6a-c7dc-4d93-af87-67a076001735 tempest-GroupSnapshotsTest-1329754185 None] group_snapshot 1212adfe-a853-42a5-af5b-c904143fba4b: deleting {{(pid=87517) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 05 11:39:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d588b6a-c7dc-4d93-af87-67a076001735 tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "cinder-quobyte-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:39:41 devstack sudo[96547]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d902791-45d5-4a96-a539-9e7747dd8367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d" returned: 0 in 0.422s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d902791-45d5-4a96-a539-9e7747dd8367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d.33380f05-0ff9-4359-bc46-6ffe4076eee3 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d588b6a-c7dc-4d93-af87-67a076001735 tempest-GroupSnapshotsTest-1329754185 None] Lock "cinder-quobyte-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:39:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d588b6a-c7dc-4d93-af87-67a076001735 tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "cinder-quobyte-10456031-4769-4d67-a466-0cd7ef8de442" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:39:41 devstack sudo[96555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d.33380f05-0ff9-4359-bc46-6ffe4076eee3 1G Sep 05 11:39:41 devstack sudo[96555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d588b6a-c7dc-4d93-af87-67a076001735 tempest-GroupSnapshotsTest-1329754185 None] Lock "cinder-quobyte-10456031-4769-4d67-a466-0cd7ef8de442" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:39:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-1d588b6a-c7dc-4d93-af87-67a076001735 tempest-GroupSnapshotsTest-1329754185 None] Deleting offline snapshot 10456031-4769-4d67-a466-0cd7ef8de442 of volume dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:39:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-1d588b6a-c7dc-4d93-af87-67a076001735 tempest-GroupSnapshotsTest-1329754185 None] snapshot_file for this snap is: volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e.10456031-4769-4d67-a466-0cd7ef8de442 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:39:41 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af65e79-715c-4659-9e4e-49ca249acaaa]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:39:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d588b6a-c7dc-4d93-af87-67a076001735 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e.10456031-4769-4d67-a466-0cd7ef8de442 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:42 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e.10456031-4769-4d67-a466-0cd7ef8de442 Sep 05 11:39:42 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:42 devstack sudo[96555]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d902791-45d5-4a96-a539-9e7747dd8367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d.33380f05-0ff9-4359-bc46-6ffe4076eee3 1G" returned: 0 in 0.463s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d902791-45d5-4a96-a539-9e7747dd8367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3580f265-e0f4-45a7-81f2-5b4c8161484d -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d.33380f05-0ff9-4359-bc46-6ffe4076eee3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:42 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3580f265-e0f4-45a7-81f2-5b4c8161484d -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d.33380f05-0ff9-4359-bc46-6ffe4076eee3 Sep 05 11:39:42 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:42 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d588b6a-c7dc-4d93-af87-67a076001735 tempest-GroupSnapshotsTest-1329754185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e.10456031-4769-4d67-a466-0cd7ef8de442" returned: 0 in 0.466s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-1d588b6a-c7dc-4d93-af87-67a076001735 tempest-GroupSnapshotsTest-1329754185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:39:42 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc76062-b616-44e0-8692-cd7d7e95c960]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:39:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d588b6a-c7dc-4d93-af87-67a076001735 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:42 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e Sep 05 11:39:42 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:42 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d902791-45d5-4a96-a539-9e7747dd8367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3580f265-e0f4-45a7-81f2-5b4c8161484d -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d.33380f05-0ff9-4359-bc46-6ffe4076eee3" returned: 0 in 0.334s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:42 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-1d902791-45d5-4a96-a539-9e7747dd8367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d.33380f05-0ff9-4359-bc46-6ffe4076eee3 is being set with open permissions: ugo+rw Sep 05 11:39:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d902791-45d5-4a96-a539-9e7747dd8367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d.33380f05-0ff9-4359-bc46-6ffe4076eee3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:42 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d.33380f05-0ff9-4359-bc46-6ffe4076eee3 Sep 05 11:39:42 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:42 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d902791-45d5-4a96-a539-9e7747dd8367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d.33380f05-0ff9-4359-bc46-6ffe4076eee3" returned: 0 in 0.271s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d902791-45d5-4a96-a539-9e7747dd8367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:43 devstack sudo[96580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d.info Sep 05 11:39:43 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:43 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d588b6a-c7dc-4d93-af87-67a076001735 tempest-GroupSnapshotsTest-1329754185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e" returned: 0 in 0.578s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d588b6a-c7dc-4d93-af87-67a076001735 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e.10456031-4769-4d67-a466-0cd7ef8de442 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:43 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e.10456031-4769-4d67-a466-0cd7ef8de442 Sep 05 11:39:43 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:43 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d902791-45d5-4a96-a539-9e7747dd8367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d.info" returned: 0 in 0.331s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:43 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-1d902791-45d5-4a96-a539-9e7747dd8367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d.info is being set with open permissions: ugo+rw Sep 05 11:39:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d902791-45d5-4a96-a539-9e7747dd8367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:43 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d.info Sep 05 11:39:43 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:43 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d588b6a-c7dc-4d93-af87-67a076001735 tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e.10456031-4769-4d67-a466-0cd7ef8de442" returned: 0 in 0.437s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d588b6a-c7dc-4d93-af87-67a076001735 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e.10456031-4769-4d67-a466-0cd7ef8de442 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:43 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e.10456031-4769-4d67-a466-0cd7ef8de442 Sep 05 11:39:43 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:43 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d902791-45d5-4a96-a539-9e7747dd8367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d.info" returned: 0 in 0.271s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1d902791-45d5-4a96-a539-9e7747dd8367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.200s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:43 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-1d902791-45d5-4a96-a539-9e7747dd8367 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Create snapshot completed successfully Sep 05 11:39:43 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d588b6a-c7dc-4d93-af87-67a076001735 tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e.10456031-4769-4d67-a466-0cd7ef8de442" returned: 0 in 0.253s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d588b6a-c7dc-4d93-af87-67a076001735 tempest-GroupSnapshotsTest-1329754185 None] Lock "cinder-quobyte-10456031-4769-4d67-a466-0cd7ef8de442" released by "_delete_snapshot" :: held 1.856s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:39:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d588b6a-c7dc-4d93-af87-67a076001735 tempest-GroupSnapshotsTest-1329754185 None] Lock "cinder-quobyte-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e" released by "delete_snapshot" :: held 1.888s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:39:43 devstack cinder-volume[87517]: WARNING cinder.quota [None req-1d588b6a-c7dc-4d93-af87-67a076001735 tempest-GroupSnapshotsTest-1329754185 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1818075072 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1818075072, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:39:43 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-1d588b6a-c7dc-4d93-af87-67a076001735 tempest-GroupSnapshotsTest-1329754185 None] Created reservations ['296d3630-3d67-4a6a-b695-55eec032bf3d', '88bfb862-38ec-4592-ae46-e1b4134bde27', '344e827a-6999-44ff-a0be-bfc61e2facd2', 'ada74195-e81d-43a6-8a3b-e5473c575c7b'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:39:43 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-1d588b6a-c7dc-4d93-af87-67a076001735 tempest-GroupSnapshotsTest-1329754185 None] group_snapshot 1212adfe-a853-42a5-af5b-c904143fba4b: deleted successfully Sep 05 11:39:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-26d4a372-8f1d-4f42-ba7a-8f5e9eda7e79 tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "cinder-quobyte-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:39:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-26d4a372-8f1d-4f42-ba7a-8f5e9eda7e79 tempest-GroupSnapshotsTest-1329754185 None] Lock "cinder-quobyte-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e" acquired by "delete_volume" :: waited 0.030s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:39:44 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[239a25f3-e927-4a60-b55a-5a6970eb8de5]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:39:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-26d4a372-8f1d-4f42-ba7a-8f5e9eda7e79 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:44 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e Sep 05 11:39:44 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:45 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-26d4a372-8f1d-4f42-ba7a-8f5e9eda7e79 tempest-GroupSnapshotsTest-1329754185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e" returned: 0 in 0.458s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-26d4a372-8f1d-4f42-ba7a-8f5e9eda7e79 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0292d721-9cd2-47fb-9772-9fe2923c9b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Acquiring lock "cinder-33380f05-0ff9-4359-bc46-6ffe4076eee3-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:39:45 devstack sudo[96599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e Sep 05 11:39:45 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0292d721-9cd2-47fb-9772-9fe2923c9b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Lock "cinder-33380f05-0ff9-4359-bc46-6ffe4076eee3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:39:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0292d721-9cd2-47fb-9772-9fe2923c9b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Acquiring lock "cinder-quobyte-3580f265-e0f4-45a7-81f2-5b4c8161484d" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:39:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0292d721-9cd2-47fb-9772-9fe2923c9b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Lock "cinder-quobyte-3580f265-e0f4-45a7-81f2-5b4c8161484d" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:39:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0292d721-9cd2-47fb-9772-9fe2923c9b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Acquiring lock "cinder-quobyte-33380f05-0ff9-4359-bc46-6ffe4076eee3" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:39:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0292d721-9cd2-47fb-9772-9fe2923c9b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Lock "cinder-quobyte-33380f05-0ff9-4359-bc46-6ffe4076eee3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:39:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-0292d721-9cd2-47fb-9772-9fe2923c9b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Deleting offline snapshot 33380f05-0ff9-4359-bc46-6ffe4076eee3 of volume 3580f265-e0f4-45a7-81f2-5b4c8161484d {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:39:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-0292d721-9cd2-47fb-9772-9fe2923c9b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] snapshot_file for this snap is: volume-3580f265-e0f4-45a7-81f2-5b4c8161484d.33380f05-0ff9-4359-bc46-6ffe4076eee3 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:39:45 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e1dac1-561b-4634-9a82-19fbb6a5f8d3]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:39:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0292d721-9cd2-47fb-9772-9fe2923c9b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d.33380f05-0ff9-4359-bc46-6ffe4076eee3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:45 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d.33380f05-0ff9-4359-bc46-6ffe4076eee3 Sep 05 11:39:45 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:45 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-26d4a372-8f1d-4f42-ba7a-8f5e9eda7e79 tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e" returned: 0 in 0.315s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-26d4a372-8f1d-4f42-ba7a-8f5e9eda7e79 tempest-GroupSnapshotsTest-1329754185 None] Lock "cinder-quobyte-dc4b1f50-b9f4-4c9e-b7d3-e34787e7ea5e" released by "delete_volume" :: held 0.870s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:39:45 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-26d4a372-8f1d-4f42-ba7a-8f5e9eda7e79 tempest-GroupSnapshotsTest-1329754185 None] Created reservations ['453de861-05dc-4125-9714-ebd498151f7b'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:39:45 devstack cinder-volume[87517]: WARNING cinder.db.api [None req-26d4a372-8f1d-4f42-ba7a-8f5e9eda7e79 tempest-GroupSnapshotsTest-1329754185 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1818075072'] Sep 05 11:39:45 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-26d4a372-8f1d-4f42-ba7a-8f5e9eda7e79 tempest-GroupSnapshotsTest-1329754185 None] Created reservations ['d4cc935d-de77-40f1-9d0f-552ab4766f72', 'f1c854bd-9705-4284-b7e5-5ece34f774fa', 'bb71cec7-4b3b-461c-9464-1d6bcf55786a', 'a0ac135d-4995-4d4a-b19f-bdc315ce8f5a'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:39:45 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0292d721-9cd2-47fb-9772-9fe2923c9b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d.33380f05-0ff9-4359-bc46-6ffe4076eee3" returned: 0 in 0.408s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-0292d721-9cd2-47fb-9772-9fe2923c9b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3580f265-e0f4-45a7-81f2-5b4c8161484d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:39:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-26d4a372-8f1d-4f42-ba7a-8f5e9eda7e79 tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-26d4a372-8f1d-4f42-ba7a-8f5e9eda7e79 tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-26d4a372-8f1d-4f42-ba7a-8f5e9eda7e79 tempest-GroupSnapshotsTest-1329754185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:39:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-26d4a372-8f1d-4f42-ba7a-8f5e9eda7e79 tempest-GroupSnapshotsTest-1329754185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:39:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-26d4a372-8f1d-4f42-ba7a-8f5e9eda7e79 tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-26d4a372-8f1d-4f42-ba7a-8f5e9eda7e79 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:45 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f4c5fa-2035-4582-a769-0afcc3d70146]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:39:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0292d721-9cd2-47fb-9772-9fe2923c9b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:45 devstack sudo[96607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:39:45 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:45 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d Sep 05 11:39:45 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:45 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-26d4a372-8f1d-4f42-ba7a-8f5e9eda7e79 tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.298s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:45 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-26d4a372-8f1d-4f42-ba7a-8f5e9eda7e79 tempest-GroupSnapshotsTest-1329754185 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:39:45 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-26d4a372-8f1d-4f42-ba7a-8f5e9eda7e79 tempest-GroupSnapshotsTest-1329754185 None] Delete group completed successfully. Sep 05 11:39:46 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0292d721-9cd2-47fb-9772-9fe2923c9b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d" returned: 0 in 0.534s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0292d721-9cd2-47fb-9772-9fe2923c9b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d.33380f05-0ff9-4359-bc46-6ffe4076eee3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:46 devstack sudo[96615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d.33380f05-0ff9-4359-bc46-6ffe4076eee3 Sep 05 11:39:46 devstack sudo[96615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:46 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-03f07359-f1ed-425f-b682-c772a0373904 tempest-GroupSnapshotsTest-1329754185 None] Group tempest-GroupSnapshotsTest-Group-1211153891: creating Sep 05 11:39:46 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-03f07359-f1ed-425f-b682-c772a0373904 tempest-GroupSnapshotsTest-1329754185 None] Group tempest-GroupSnapshotsTest-Group-1211153891: created successfully Sep 05 11:39:46 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-03f07359-f1ed-425f-b682-c772a0373904 tempest-GroupSnapshotsTest-1329754185 None] Create group completed successfully. Sep 05 11:39:46 devstack sudo[96615]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0292d721-9cd2-47fb-9772-9fe2923c9b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d.33380f05-0ff9-4359-bc46-6ffe4076eee3" returned: 0 in 0.383s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0292d721-9cd2-47fb-9772-9fe2923c9b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d.33380f05-0ff9-4359-bc46-6ffe4076eee3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:46 devstack sudo[96620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d.33380f05-0ff9-4359-bc46-6ffe4076eee3 Sep 05 11:39:46 devstack sudo[96620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:46 devstack sudo[96620]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0292d721-9cd2-47fb-9772-9fe2923c9b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d.33380f05-0ff9-4359-bc46-6ffe4076eee3" returned: 0 in 0.239s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0292d721-9cd2-47fb-9772-9fe2923c9b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Lock "cinder-quobyte-33380f05-0ff9-4359-bc46-6ffe4076eee3" released by "_delete_snapshot" :: held 1.694s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:39:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0292d721-9cd2-47fb-9772-9fe2923c9b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Lock "cinder-quobyte-3580f265-e0f4-45a7-81f2-5b4c8161484d" released by "delete_snapshot" :: held 1.720s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:39:46 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-0292d721-9cd2-47fb-9772-9fe2923c9b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Created reservations ['8fa4976f-f922-4b43-960f-0124133bd56b', '26c12682-db39-46b1-92eb-3bc374e8edcf', '202c0793-3641-4c1d-9735-215f400e7e71', '47508042-83ed-415c-91d1-a5e903080b75'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:39:46 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-0292d721-9cd2-47fb-9772-9fe2923c9b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Delete snapshot completed successfully. Sep 05 11:39:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0292d721-9cd2-47fb-9772-9fe2923c9b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Lock "cinder-33380f05-0ff9-4359-bc46-6ffe4076eee3-delete_snapshot" released by "delete_snapshot" :: held 1.884s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:39:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a8caeab3-a988-4f91-a3a3-11836ae16285 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Acquiring lock "cinder-3580f265-e0f4-45a7-81f2-5b4c8161484d-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:39:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a8caeab3-a988-4f91-a3a3-11836ae16285 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Lock "cinder-3580f265-e0f4-45a7-81f2-5b4c8161484d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:39:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a8caeab3-a988-4f91-a3a3-11836ae16285 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Acquiring lock "cinder-quobyte-3580f265-e0f4-45a7-81f2-5b4c8161484d" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:39:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a8caeab3-a988-4f91-a3a3-11836ae16285 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Lock "cinder-quobyte-3580f265-e0f4-45a7-81f2-5b4c8161484d" acquired by "delete_volume" :: waited 0.028s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:39:47 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[032f06a2-3e6a-44ed-a6b4-7bf048ce89ae]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:39:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a8caeab3-a988-4f91-a3a3-11836ae16285 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:47 devstack sudo[96623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d Sep 05 11:39:47 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:47 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a8caeab3-a988-4f91-a3a3-11836ae16285 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d" returned: 0 in 0.443s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a8caeab3-a988-4f91-a3a3-11836ae16285 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:47 devstack sudo[96629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d Sep 05 11:39:47 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] Flow 'volume_create_manager' (83581265-d0a6-4b01-aad4-2f18ca84974d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e485e8c6-8c80-449b-a984-5a82d9e5fbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e485e8c6-8c80-449b-a984-5a82d9e5fbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1274948974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=76c7e0fe-ebf2-4952-af5c-4f55f7793453,host='devstack@QuobyteHD#QuobyteHD',id=67b1919c-ff18-4cdb-b92b-65edac2c4f9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4079d39981204503bfd20ba7cc776fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:39:48Z,use_quota=True,user_id='588c3314c4e3499dbe1b69e79f149fdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b63ae62-9566-4366-bde3-83c57509bd1b),volume_type_id=0b63ae62-9566-4366-bde3-83c57509bd1b)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b6f5112-763b-4f41-a265-3018ddc53f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b6f5112-763b-4f41-a265-3018ddc53f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1142ab86-db5e-468d-9ed3-c10938f210d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1142ab86-db5e-468d-9ed3-c10938f210d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67b1919c-ff18-4cdb-b92b-65edac2c4f9c', 'volume_name': 'volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a77109-7542-4338-9bac-f12501e94bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a77109-7542-4338-9bac-f12501e94bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b50b471-751a-4fc7-832e-8cbdc0f436bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:48 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] Volume 67b1919c-ff18-4cdb-b92b-65edac2c4f9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c', 'volume_size': 1} Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=76c7e0fe-ebf2-4952-af5c-4f55f7793453,created_at=2026-09-05T09:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1274948974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=76c7e0fe-ebf2-4952-af5c-4f55f7793453,host='devstack@QuobyteHD#QuobyteHD',id=67b1919c-ff18-4cdb-b92b-65edac2c4f9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4079d39981204503bfd20ba7cc776fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:39:48Z,use_quota=True,user_id='588c3314c4e3499dbe1b69e79f149fdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b63ae62-9566-4366-bde3-83c57509bd1b),volume_type_id=0b63ae62-9566-4366-bde3-83c57509bd1b)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] Creating volume 67b1919c-ff18-4cdb-b92b-65edac2c4f9c {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:39:48 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:39:48 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a8caeab3-a988-4f91-a3a3-11836ae16285 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3580f265-e0f4-45a7-81f2-5b4c8161484d" returned: 0 in 0.378s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:48 devstack sudo[96632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c 1073741824 Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a8caeab3-a988-4f91-a3a3-11836ae16285 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Lock "cinder-quobyte-3580f265-e0f4-45a7-81f2-5b4c8161484d" released by "delete_volume" :: held 0.897s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:39:48 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-a8caeab3-a988-4f91-a3a3-11836ae16285 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Created reservations ['2da24db9-170b-46bf-b40c-1218367f2179', '08a904df-9d21-45a1-9795-3a3014f0178b', '0cf8a24c-e752-4f50-b514-ab6749653d11', '4c6764fd-decc-4119-80a2-d39a7589066d'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a8caeab3-a988-4f91-a3a3-11836ae16285 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a8caeab3-a988-4f91-a3a3-11836ae16285 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a8caeab3-a988-4f91-a3a3-11836ae16285 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a8caeab3-a988-4f91-a3a3-11836ae16285 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a8caeab3-a988-4f91-a3a3-11836ae16285 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a8caeab3-a988-4f91-a3a3-11836ae16285 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:48 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:39:48 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:48 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a8caeab3-a988-4f91-a3a3-11836ae16285 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.325s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-a8caeab3-a988-4f91-a3a3-11836ae16285 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:39:48 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a8caeab3-a988-4f91-a3a3-11836ae16285 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Deleted volume successfully. Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a8caeab3-a988-4f91-a3a3-11836ae16285 tempest-VolumeSnapshotQuotasNegativeTestJSON-2061385014 None] Lock "cinder-3580f265-e0f4-45a7-81f2-5b4c8161484d-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:39:48 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c 1073741824" returned: 0 in 0.639s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:48 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c Sep 05 11:39:48 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:49 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c" returned: 0 in 0.371s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:39:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b50b471-751a-4fc7-832e-8cbdc0f436bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d973de8-e7bb-4514-8f1a-3fe002f5090b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:49 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] Volume volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c (67b1919c-ff18-4cdb-b92b-65edac2c4f9c): created successfully Sep 05 11:39:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d973de8-e7bb-4514-8f1a-3fe002f5090b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] Flow 'volume_create_manager' (83581265-d0a6-4b01-aad4-2f18ca84974d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:39:49 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-1a52e5e5-d577-484d-a148-b83f9f896fe7 tempest-GroupSnapshotsTest-1329754185 None] Created volume successfully. Sep 05 11:39:51 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:39:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] Flow 'volume_create_manager' (1e38ab40-bb57-40b4-be6d-169aa436c82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:39:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (752216e8-199f-457a-bd31-c5ed4b59bc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (752216e8-199f-457a-bd31-c5ed4b59bc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1807509801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=76c7e0fe-ebf2-4952-af5c-4f55f7793453,host='devstack@QuobyteHD#QuobyteHD',id=2f97930a-24a7-4ed8-9b4e-6ab7a709854f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4079d39981204503bfd20ba7cc776fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:39:51Z,use_quota=True,user_id='588c3314c4e3499dbe1b69e79f149fdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b63ae62-9566-4366-bde3-83c57509bd1b),volume_type_id=0b63ae62-9566-4366-bde3-83c57509bd1b)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e720ebb-5456-4174-a99b-1248a204e65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e720ebb-5456-4174-a99b-1248a204e65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3fcae4-a949-4e4a-8811-3b9067f813ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3fcae4-a949-4e4a-8811-3b9067f813ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f97930a-24a7-4ed8-9b4e-6ab7a709854f', 'volume_name': 'volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb9b227-aebe-49ed-8342-d9c7165464bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb9b227-aebe-49ed-8342-d9c7165464bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (991dfb1e-1d98-42df-954c-d9314c6678f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:51 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] Volume 2f97930a-24a7-4ed8-9b4e-6ab7a709854f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f', 'volume_size': 1} Sep 05 11:39:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=76c7e0fe-ebf2-4952-af5c-4f55f7793453,created_at=2026-09-05T09:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1807509801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=76c7e0fe-ebf2-4952-af5c-4f55f7793453,host='devstack@QuobyteHD#QuobyteHD',id=2f97930a-24a7-4ed8-9b4e-6ab7a709854f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4079d39981204503bfd20ba7cc776fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:39:51Z,use_quota=True,user_id='588c3314c4e3499dbe1b69e79f149fdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b63ae62-9566-4366-bde3-83c57509bd1b),volume_type_id=0b63ae62-9566-4366-bde3-83c57509bd1b)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:39:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] Creating volume 2f97930a-24a7-4ed8-9b4e-6ab7a709854f {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:39:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:39:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:39:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:39:51 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:39:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:51 devstack sudo[96659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f 1073741824 Sep 05 11:39:51 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:52 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f 1073741824" returned: 0 in 0.588s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:52 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f Sep 05 11:39:52 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:52 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f" returned: 0 in 0.377s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:52 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:39:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (991dfb1e-1d98-42df-954c-d9314c6678f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (081d6c86-4937-4a23-b56a-c45ca0318c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:52 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] Volume volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f (2f97930a-24a7-4ed8-9b4e-6ab7a709854f): created successfully Sep 05 11:39:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (081d6c86-4937-4a23-b56a-c45ca0318c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] Flow 'volume_create_manager' (1e38ab40-bb57-40b4-be6d-169aa436c82a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:39:52 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-85edc023-a767-4267-bf65-dc78a9c5a219 tempest-GroupSnapshotsTest-1329754185 None] Created volume successfully. Sep 05 11:39:53 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a84d726c-447a-4bd0-8cca-8e6dbdd45515 tempest-GroupSnapshotsTest-1329754185 None] Update group completed successfully. Sep 05 11:39:54 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f88d791d-587c-4bd8-87ea-755e820d49c1 tempest-GroupSnapshotsTest-1329754185 None] Update group completed successfully. Sep 05 11:39:54 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-833cf443-ec15-4930-a5ca-fb236df1df67 req-12d3295c-e475-42a7-a3eb-acfb8e2d07f3 tempest-TestShelveInstance-1424890929 None] Terminate volume connection completed successfully. Sep 05 11:39:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-833cf443-ec15-4930-a5ca-fb236df1df67 req-12d3295c-e475-42a7-a3eb-acfb8e2d07f3 tempest-TestShelveInstance-1424890929 None] Deleting attachment 52686804-f8a7-4c44-ab1d-6484bb3a1b7e. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 11:39:55 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d5574d4f-42cc-447d-a783-887009bcbe6c tempest-GroupSnapshotsTest-1329754185 None] Update group completed successfully. Sep 05 11:39:56 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a0507f29-fded-4d84-bff3-0410fff34df9 tempest-GroupSnapshotsTest-1329754185 None] Update group completed successfully. Sep 05 11:39:57 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:39:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] Flow 'volume_create_manager' (62997681-dbe9-4500-ae18-578cddcf9764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:39:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (277521d2-8fbb-4f7d-b0e6-e7abb91076e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (277521d2-8fbb-4f7d-b0e6-e7abb91076e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-502728127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0429cdd1-50da-4476-a906-640998c57829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='684e781e7f1b4ce699a5aa89e94fdc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:39:58Z,use_quota=True,user_id='6315710d86a5421182a4b4e91efcea28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f1ba67b-814c-4aa1-9f8d-93af8a9fc42b),volume_type_id=1f1ba67b-814c-4aa1-9f8d-93af8a9fc42b)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8d9e11d-3fbb-4623-94d3-6886ded83604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8d9e11d-3fbb-4623-94d3-6886ded83604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4853759e-5a37-4a41-9022-27c680191df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4853759e-5a37-4a41-9022-27c680191df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0429cdd1-50da-4476-a906-640998c57829', 'volume_name': 'volume-0429cdd1-50da-4476-a906-640998c57829', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec30a244-8bb4-4feb-836e-435018e16292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec30a244-8bb4-4feb-836e-435018e16292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a052b0-2b8e-4bf9-a197-602be213e883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:57 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] Volume 0429cdd1-50da-4476-a906-640998c57829: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0429cdd1-50da-4476-a906-640998c57829', 'volume_size': 1} Sep 05 11:39:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-502728127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0429cdd1-50da-4476-a906-640998c57829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='684e781e7f1b4ce699a5aa89e94fdc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:39:58Z,use_quota=True,user_id='6315710d86a5421182a4b4e91efcea28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f1ba67b-814c-4aa1-9f8d-93af8a9fc42b),volume_type_id=1f1ba67b-814c-4aa1-9f8d-93af8a9fc42b)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:39:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] Creating volume 0429cdd1-50da-4476-a906-640998c57829 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:39:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:39:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:39:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:39:57 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:39:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0429cdd1-50da-4476-a906-640998c57829 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-8b9c5c7a-6005-417b-a851-fa08066ccffa req-445d6e80-ff38-403e-82e8-584c5ec589f2 tempest-TestShelveInstance-1424890929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:57 devstack sudo[96703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0429cdd1-50da-4476-a906-640998c57829 1073741824 Sep 05 11:39:57 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:58 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0429cdd1-50da-4476-a906-640998c57829 1073741824" returned: 0 in 0.594s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0429cdd1-50da-4476-a906-640998c57829 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:58 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0429cdd1-50da-4476-a906-640998c57829 Sep 05 11:39:58 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:58 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] GroupSnapshot 476cd270-88ec-4629-8ae0-6957c218819e: creating. Sep 05 11:39:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] Group snapshot 476cd270-88ec-4629-8ae0-6957c218819e: creating. {{(pid=87517) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 05 11:39:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:39:58 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0429cdd1-50da-4476-a906-640998c57829" returned: 0 in 0.365s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:39:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-8b9c5c7a-6005-417b-a851-fa08066ccffa req-445d6e80-ff38-403e-82e8-584c5ec589f2 tempest-TestShelveInstance-1424890929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.015s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-8b9c5c7a-6005-417b-a851-fa08066ccffa req-445d6e80-ff38-403e-82e8-584c5ec589f2 tempest-TestShelveInstance-1424890929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:39:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.132s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:39:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a052b0-2b8e-4bf9-a197-602be213e883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0429cdd1-50da-4476-a906-640998c57829', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c5ec8de-20a5-47ff-8b9b-84d8318f2deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:39:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] Creating offline snapshot 6f47d0ec-13f7-4f07-8429-e327ea14ad7b of volume 67b1919c-ff18-4cdb-b92b-65edac2c4f9c {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:39:58 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] Volume volume-0429cdd1-50da-4476-a906-640998c57829 (0429cdd1-50da-4476-a906-640998c57829): created successfully Sep 05 11:39:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c5ec8de-20a5-47ff-8b9b-84d8318f2deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:39:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] Flow 'volume_create_manager' (62997681-dbe9-4500-ae18-578cddcf9764) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:39:58 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3aaf665-6350-467b-a2f2-406e15dbd134]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:39:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:58 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-0d754e17-330d-43e1-9de7-84e5c0955967 tempest-VolumeTypesAccessTest-782681872 None] Created volume successfully. Sep 05 11:39:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-8b9c5c7a-6005-417b-a851-fa08066ccffa req-445d6e80-ff38-403e-82e8-584c5ec589f2 tempest-TestShelveInstance-1424890929 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32', 'name': 'volume-e07f2cf7-3339-444a-b467-affe67a8a31d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dcfc9792-2759-4d99-b8a6-feadc76533ad', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 11:39:59 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-8b9c5c7a-6005-417b-a851-fa08066ccffa req-445d6e80-ff38-403e-82e8-584c5ec589f2 tempest-TestShelveInstance-1424890929 None] attachment_update completed successfully. Sep 05 11:39:59 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c Sep 05 11:39:59 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:39:59 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Sep 05 11:39:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c" returned: 0 in 0.617s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:39:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c.6f47d0ec-13f7-4f07-8429-e327ea14ad7b 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:39:59 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c.6f47d0ec-13f7-4f07-8429-e327ea14ad7b 1G Sep 05 11:39:59 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-75a2d791-c12e-4d67-a133-823ba8285b97 tempest-VolumeTypesAccessTest-782681872 None] Acquiring lock "cinder-0429cdd1-50da-4476-a906-640998c57829-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:40:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-75a2d791-c12e-4d67-a133-823ba8285b97 tempest-VolumeTypesAccessTest-782681872 None] Lock "cinder-0429cdd1-50da-4476-a906-640998c57829-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:40:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-75a2d791-c12e-4d67-a133-823ba8285b97 tempest-VolumeTypesAccessTest-782681872 None] Acquiring lock "cinder-quobyte-0429cdd1-50da-4476-a906-640998c57829" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:40:00 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c.6f47d0ec-13f7-4f07-8429-e327ea14ad7b 1G" returned: 0 in 0.849s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c.6f47d0ec-13f7-4f07-8429-e327ea14ad7b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-75a2d791-c12e-4d67-a133-823ba8285b97 tempest-VolumeTypesAccessTest-782681872 None] Lock "cinder-quobyte-0429cdd1-50da-4476-a906-640998c57829" acquired by "delete_volume" :: waited 0.060s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:40:00 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c.6f47d0ec-13f7-4f07-8429-e327ea14ad7b Sep 05 11:40:00 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:00 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a26299-f8b2-43d2-b623-e843b318ff89]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:40:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-75a2d791-c12e-4d67-a133-823ba8285b97 tempest-VolumeTypesAccessTest-782681872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0429cdd1-50da-4476-a906-640998c57829 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:00 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0429cdd1-50da-4476-a906-640998c57829 Sep 05 11:40:00 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:00 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c.6f47d0ec-13f7-4f07-8429-e327ea14ad7b" returned: 0 in 0.565s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:00 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c.6f47d0ec-13f7-4f07-8429-e327ea14ad7b is being set with open permissions: ugo+rw: NotImplementedError Sep 05 11:40:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c.6f47d0ec-13f7-4f07-8429-e327ea14ad7b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:00 devstack sudo[96748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c.6f47d0ec-13f7-4f07-8429-e327ea14ad7b Sep 05 11:40:00 devstack sudo[96748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:01 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-75a2d791-c12e-4d67-a133-823ba8285b97 tempest-VolumeTypesAccessTest-782681872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0429cdd1-50da-4476-a906-640998c57829" returned: 0 in 0.641s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-75a2d791-c12e-4d67-a133-823ba8285b97 tempest-VolumeTypesAccessTest-782681872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0429cdd1-50da-4476-a906-640998c57829 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:01 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0429cdd1-50da-4476-a906-640998c57829 Sep 05 11:40:01 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:01 devstack sudo[96748]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c.6f47d0ec-13f7-4f07-8429-e327ea14ad7b" returned: 0 in 0.353s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:01 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c.info Sep 05 11:40:01 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:01 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-75a2d791-c12e-4d67-a133-823ba8285b97 tempest-VolumeTypesAccessTest-782681872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0429cdd1-50da-4476-a906-640998c57829" returned: 0 in 0.321s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-75a2d791-c12e-4d67-a133-823ba8285b97 tempest-VolumeTypesAccessTest-782681872 None] Lock "cinder-quobyte-0429cdd1-50da-4476-a906-640998c57829" released by "delete_volume" :: held 1.045s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:40:01 devstack cinder-volume[87517]: WARNING cinder.quota [None req-75a2d791-c12e-4d67-a133-823ba8285b97 tempest-VolumeTypesAccessTest-782681872 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-10874924 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-10874924, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:40:01 devstack cinder-volume[87517]: WARNING cinder.quota [None req-75a2d791-c12e-4d67-a133-823ba8285b97 tempest-VolumeTypesAccessTest-782681872 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-10874924 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-10874924, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:40:01 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-75a2d791-c12e-4d67-a133-823ba8285b97 tempest-VolumeTypesAccessTest-782681872 None] Created reservations ['90dacf69-ceb9-42c3-b958-10c283353614', '36d398b4-779d-4e1a-9843-b848df010abf', '796e18d1-e606-4f25-800c-faa40d295849', 'bf523fb2-d9a8-40be-b2ca-8f155f2c373a'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:40:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-75a2d791-c12e-4d67-a133-823ba8285b97 tempest-VolumeTypesAccessTest-782681872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:40:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-75a2d791-c12e-4d67-a133-823ba8285b97 tempest-VolumeTypesAccessTest-782681872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:40:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-75a2d791-c12e-4d67-a133-823ba8285b97 tempest-VolumeTypesAccessTest-782681872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:40:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-75a2d791-c12e-4d67-a133-823ba8285b97 tempest-VolumeTypesAccessTest-782681872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:40:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-75a2d791-c12e-4d67-a133-823ba8285b97 tempest-VolumeTypesAccessTest-782681872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:40:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-75a2d791-c12e-4d67-a133-823ba8285b97 tempest-VolumeTypesAccessTest-782681872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:01 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:01 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:40:01 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c.info" returned: 0 in 0.319s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:01 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 05 11:40:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:01 devstack sudo[96763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c.info Sep 05 11:40:01 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:01 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-75a2d791-c12e-4d67-a133-823ba8285b97 tempest-VolumeTypesAccessTest-782681872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.305s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:01 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-75a2d791-c12e-4d67-a133-823ba8285b97 tempest-VolumeTypesAccessTest-782681872 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:40:01 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-75a2d791-c12e-4d67-a133-823ba8285b97 tempest-VolumeTypesAccessTest-782681872 None] Deleted volume successfully. Sep 05 11:40:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-75a2d791-c12e-4d67-a133-823ba8285b97 tempest-VolumeTypesAccessTest-782681872 None] Lock "cinder-0429cdd1-50da-4476-a906-640998c57829-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:40:02 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c.info" returned: 0 in 0.372s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.221s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:40:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:40:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:40:02 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] Creating offline snapshot d977f9fa-3417-4377-96e3-6b5e63b96c6d of volume 2f97930a-24a7-4ed8-9b4e-6ab7a709854f {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:40:02 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a0e1fe-07a8-44b7-8553-9ae2b739a45d]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:40:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:02 devstack sudo[96768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f Sep 05 11:40:02 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:02 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f" returned: 0 in 0.438s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f.d977f9fa-3417-4377-96e3-6b5e63b96c6d 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:02 devstack sudo[96774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f.d977f9fa-3417-4377-96e3-6b5e63b96c6d 1G Sep 05 11:40:02 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:03 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f.d977f9fa-3417-4377-96e3-6b5e63b96c6d 1G" returned: 0 in 0.587s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f.d977f9fa-3417-4377-96e3-6b5e63b96c6d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:03 devstack sudo[96780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f.d977f9fa-3417-4377-96e3-6b5e63b96c6d Sep 05 11:40:03 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:03 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f.d977f9fa-3417-4377-96e3-6b5e63b96c6d" returned: 0 in 0.659s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:03 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f.d977f9fa-3417-4377-96e3-6b5e63b96c6d is being set with open permissions: ugo+rw: NotImplementedError Sep 05 11:40:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f.d977f9fa-3417-4377-96e3-6b5e63b96c6d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:03 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f.d977f9fa-3417-4377-96e3-6b5e63b96c6d Sep 05 11:40:03 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:04 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f.d977f9fa-3417-4377-96e3-6b5e63b96c6d" returned: 0 in 0.693s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:04 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f.info Sep 05 11:40:04 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:05 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f.info" returned: 0 in 0.713s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:05 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f.info is being set with open permissions: ugo+rw: NotImplementedError Sep 05 11:40:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:05 devstack sudo[97268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f.info Sep 05 11:40:05 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:05 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f.info" returned: 0 in 0.662s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.958s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:40:06 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d0327b6b-c550-43ae-8f4d-730bd27abd9a tempest-GroupSnapshotsTest-1329754185 None] group_snapshot 476cd270-88ec-4629-8ae0-6957c218819e: created successfully Sep 05 11:40:07 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] group_snapshot 476cd270-88ec-4629-8ae0-6957c218819e: deleting Sep 05 11:40:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] group_snapshot 476cd270-88ec-4629-8ae0-6957c218819e: deleting {{(pid=87517) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 05 11:40:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "cinder-quobyte-67b1919c-ff18-4cdb-b92b-65edac2c4f9c" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:40:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] Lock "cinder-quobyte-67b1919c-ff18-4cdb-b92b-65edac2c4f9c" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:40:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "cinder-quobyte-6f47d0ec-13f7-4f07-8429-e327ea14ad7b" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:40:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] Lock "cinder-quobyte-6f47d0ec-13f7-4f07-8429-e327ea14ad7b" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:40:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] Deleting offline snapshot 6f47d0ec-13f7-4f07-8429-e327ea14ad7b of volume 67b1919c-ff18-4cdb-b92b-65edac2c4f9c {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:40:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] snapshot_file for this snap is: volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c.6f47d0ec-13f7-4f07-8429-e327ea14ad7b {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:40:08 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2889a16d-f7a5-4ede-aa18-34cd213eb651]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:40:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c.6f47d0ec-13f7-4f07-8429-e327ea14ad7b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:08 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c.6f47d0ec-13f7-4f07-8429-e327ea14ad7b Sep 05 11:40:08 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:08 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c.6f47d0ec-13f7-4f07-8429-e327ea14ad7b" returned: 0 in 0.749s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:40:09 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3294853-99ec-4f1b-be03-d67f3377d3a8]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:40:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:09 devstack sudo[97308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c Sep 05 11:40:09 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:09 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c" returned: 0 in 0.671s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c.6f47d0ec-13f7-4f07-8429-e327ea14ad7b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:09 devstack sudo[97313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c.6f47d0ec-13f7-4f07-8429-e327ea14ad7b Sep 05 11:40:09 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:10 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c.6f47d0ec-13f7-4f07-8429-e327ea14ad7b" returned: 0 in 0.682s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c.6f47d0ec-13f7-4f07-8429-e327ea14ad7b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:10 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c.6f47d0ec-13f7-4f07-8429-e327ea14ad7b Sep 05 11:40:10 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:10 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c.6f47d0ec-13f7-4f07-8429-e327ea14ad7b" returned: 0 in 0.454s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] Lock "cinder-quobyte-6f47d0ec-13f7-4f07-8429-e327ea14ad7b" released by "_delete_snapshot" :: held 2.821s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:40:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] Lock "cinder-quobyte-67b1919c-ff18-4cdb-b92b-65edac2c4f9c" released by "delete_snapshot" :: held 2.872s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:40:10 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=140,cinder:SELECT=127,cinder:INSERT=29,cinder:DELETE=11 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:40:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "cinder-quobyte-2f97930a-24a7-4ed8-9b4e-6ab7a709854f" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:40:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] Lock "cinder-quobyte-2f97930a-24a7-4ed8-9b4e-6ab7a709854f" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:40:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "cinder-quobyte-d977f9fa-3417-4377-96e3-6b5e63b96c6d" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:40:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] Lock "cinder-quobyte-d977f9fa-3417-4377-96e3-6b5e63b96c6d" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:40:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] Deleting offline snapshot d977f9fa-3417-4377-96e3-6b5e63b96c6d of volume 2f97930a-24a7-4ed8-9b4e-6ab7a709854f {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:40:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] snapshot_file for this snap is: volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f.d977f9fa-3417-4377-96e3-6b5e63b96c6d {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:40:11 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[53888df7-ad50-43f6-aea4-fbfbd57e92df]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:40:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f.d977f9fa-3417-4377-96e3-6b5e63b96c6d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:11 devstack sudo[97323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f.d977f9fa-3417-4377-96e3-6b5e63b96c6d Sep 05 11:40:11 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:11 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f.d977f9fa-3417-4377-96e3-6b5e63b96c6d" returned: 0 in 0.709s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:40:11 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47bc036-b8ac-4d4b-b384-104ceefbecfd]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:40:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:12 devstack sudo[97329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f Sep 05 11:40:12 devstack sudo[97329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:12 devstack sudo[97329]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f" returned: 0 in 0.638s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f.d977f9fa-3417-4377-96e3-6b5e63b96c6d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:12 devstack sudo[97335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f.d977f9fa-3417-4377-96e3-6b5e63b96c6d Sep 05 11:40:12 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:13 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f.d977f9fa-3417-4377-96e3-6b5e63b96c6d" returned: 0 in 0.617s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f.d977f9fa-3417-4377-96e3-6b5e63b96c6d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:13 devstack sudo[97340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f.d977f9fa-3417-4377-96e3-6b5e63b96c6d Sep 05 11:40:13 devstack sudo[97340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:13 devstack sudo[97340]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f.d977f9fa-3417-4377-96e3-6b5e63b96c6d" returned: 0 in 0.444s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] Lock "cinder-quobyte-d977f9fa-3417-4377-96e3-6b5e63b96c6d" released by "_delete_snapshot" :: held 2.608s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:40:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] Lock "cinder-quobyte-2f97930a-24a7-4ed8-9b4e-6ab7a709854f" released by "delete_snapshot" :: held 2.658s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:40:13 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=135,cinder:DELETE=5,cinder:SELECT=129,cinder:INSERT=32 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:40:13 devstack cinder-volume[87517]: WARNING cinder.quota [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1291766133 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1291766133, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:40:13 devstack cinder-volume[87517]: WARNING cinder.quota [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1291766133 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1291766133, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:40:13 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] Created reservations ['13ecf597-3bd5-48cc-8b36-5d7b41c89b28', 'a5a885dd-e19e-4e6b-b0e8-6e3c42c6718a', '3669763d-d79f-4be0-8b1d-20099e64a55c', 'ebf3c9a1-712b-4772-af74-b32b564af16b'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:40:14 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] Created reservations ['14c3290e-46c2-47af-9fc2-7e328cf268e9', '9ce093f5-6404-45eb-87d7-faf8de999898', '1d733805-0e2f-471f-a883-5a33aa73b042', '8a08d57c-a85e-4583-9334-d274bc39dc9f'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:40:14 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-927cc35a-aa3d-4deb-b8da-83f72abb9b40 tempest-GroupSnapshotsTest-1329754185 None] group_snapshot 476cd270-88ec-4629-8ae0-6957c218819e: deleted successfully Sep 05 11:40:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ff4ec371-b6c6-41b2-95bc-29caa18ffc48 tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "cinder-quobyte-2f97930a-24a7-4ed8-9b4e-6ab7a709854f" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:40:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ff4ec371-b6c6-41b2-95bc-29caa18ffc48 tempest-GroupSnapshotsTest-1329754185 None] Lock "cinder-quobyte-2f97930a-24a7-4ed8-9b4e-6ab7a709854f" acquired by "delete_volume" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:40:15 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07ea78f-df5f-4be3-9fba-1360a844ff6b]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:40:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ff4ec371-b6c6-41b2-95bc-29caa18ffc48 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:15 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f Sep 05 11:40:15 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:16 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ff4ec371-b6c6-41b2-95bc-29caa18ffc48 tempest-GroupSnapshotsTest-1329754185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f" returned: 0 in 0.487s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ff4ec371-b6c6-41b2-95bc-29caa18ffc48 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:16 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f Sep 05 11:40:16 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:16 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ff4ec371-b6c6-41b2-95bc-29caa18ffc48 tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2f97930a-24a7-4ed8-9b4e-6ab7a709854f" returned: 0 in 0.348s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ff4ec371-b6c6-41b2-95bc-29caa18ffc48 tempest-GroupSnapshotsTest-1329754185 None] Lock "cinder-quobyte-2f97930a-24a7-4ed8-9b4e-6ab7a709854f" released by "delete_volume" :: held 0.944s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:40:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ff4ec371-b6c6-41b2-95bc-29caa18ffc48 tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "cinder-quobyte-67b1919c-ff18-4cdb-b92b-65edac2c4f9c" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:40:16 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:40:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] Flow 'volume_create_manager' (fb5d7622-0638-4ab8-8ee9-e04351b32222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:40:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6649959d-0f86-4187-b47e-b170de357d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ff4ec371-b6c6-41b2-95bc-29caa18ffc48 tempest-GroupSnapshotsTest-1329754185 None] Lock "cinder-quobyte-67b1919c-ff18-4cdb-b92b-65edac2c4f9c" acquired by "delete_volume" :: waited 0.082s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:40:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6649959d-0f86-4187-b47e-b170de357d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-820693594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88279242-9467-40bb-958b-8ce995efc6a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1bc005bd1a4886ac49a4ef12130c04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:40:17Z,use_quota=True,user_id='6720399ff688456482f2d42a9638183c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7efc411a-0493-4335-9987-4ea4b3b94870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7efc411a-0493-4335-9987-4ea4b3b94870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69bc9026-a692-46e7-98fd-3bd71fca8e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69bc9026-a692-46e7-98fd-3bd71fca8e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88279242-9467-40bb-958b-8ce995efc6a0', 'volume_name': 'volume-88279242-9467-40bb-958b-8ce995efc6a0', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd0a464-a6b6-4c74-8fe3-ca15af10a21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd0a464-a6b6-4c74-8fe3-ca15af10a21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd8c8631-ebfb-4a0a-be1b-de4e394ce46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:16 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] Volume 88279242-9467-40bb-958b-8ce995efc6a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88279242-9467-40bb-958b-8ce995efc6a0', 'volume_size': 1} Sep 05 11:40:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:40:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:40:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-820693594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88279242-9467-40bb-958b-8ce995efc6a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1bc005bd1a4886ac49a4ef12130c04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:40:17Z,use_quota=True,user_id='6720399ff688456482f2d42a9638183c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:40:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] Creating volume 88279242-9467-40bb-958b-8ce995efc6a0 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:40:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:40:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:40:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:40:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:40:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:40:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:40:16 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:40:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-88279242-9467-40bb-958b-8ce995efc6a0 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:16 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[578e7507-9c40-48e1-9be9-7274d0321e62]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:40:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ff4ec371-b6c6-41b2-95bc-29caa18ffc48 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:16 devstack sudo[97351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-88279242-9467-40bb-958b-8ce995efc6a0 1073741824 Sep 05 11:40:16 devstack sudo[97351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:17 devstack sudo[97352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c Sep 05 11:40:17 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:17 devstack sudo[97351]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-88279242-9467-40bb-958b-8ce995efc6a0 1073741824" returned: 0 in 0.522s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:17 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ff4ec371-b6c6-41b2-95bc-29caa18ffc48 tempest-GroupSnapshotsTest-1329754185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c" returned: 0 in 0.552s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ff4ec371-b6c6-41b2-95bc-29caa18ffc48 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-88279242-9467-40bb-958b-8ce995efc6a0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:17 devstack sudo[97363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c Sep 05 11:40:17 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:17 devstack sudo[97364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-88279242-9467-40bb-958b-8ce995efc6a0 Sep 05 11:40:17 devstack sudo[97364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:17 devstack sudo[97364]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-88279242-9467-40bb-958b-8ce995efc6a0" returned: 0 in 0.285s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:40:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:40:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd8c8631-ebfb-4a0a-be1b-de4e394ce46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88279242-9467-40bb-958b-8ce995efc6a0', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2473d813-f13b-4ef3-9b07-649415a122b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:17 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:17 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] Volume volume-88279242-9467-40bb-958b-8ce995efc6a0 (88279242-9467-40bb-958b-8ce995efc6a0): created successfully Sep 05 11:40:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2473d813-f13b-4ef3-9b07-649415a122b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] Flow 'volume_create_manager' (fb5d7622-0638-4ab8-8ee9-e04351b32222) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:40:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ff4ec371-b6c6-41b2-95bc-29caa18ffc48 tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67b1919c-ff18-4cdb-b92b-65edac2c4f9c" returned: 0 in 0.381s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:17 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-8749c76c-b486-4b01-9e9a-b34a06725e0c tempest-VolumesMetadataTest-1607197852 None] Created volume successfully. Sep 05 11:40:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ff4ec371-b6c6-41b2-95bc-29caa18ffc48 tempest-GroupSnapshotsTest-1329754185 None] Lock "cinder-quobyte-67b1919c-ff18-4cdb-b92b-65edac2c4f9c" released by "delete_volume" :: held 1.065s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:40:17 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-ff4ec371-b6c6-41b2-95bc-29caa18ffc48 tempest-GroupSnapshotsTest-1329754185 None] Created reservations ['a5aa2263-8f0d-41ba-8adf-d4359ce00913'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:40:17 devstack cinder-volume[87517]: WARNING cinder.quota [None req-ff4ec371-b6c6-41b2-95bc-29caa18ffc48 tempest-GroupSnapshotsTest-1329754185 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1291766133 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1291766133, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:40:17 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-ff4ec371-b6c6-41b2-95bc-29caa18ffc48 tempest-GroupSnapshotsTest-1329754185 None] Created reservations ['00670b16-4cf4-422e-9dcf-abc9da192769', 'aa21fa21-958a-4906-99a3-1d0a46b9f815', 'af82fef2-4730-4b28-af76-25b4d3779cdd', 'a0a4b706-5797-446b-aa66-e266bf7d053d'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:40:18 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-ff4ec371-b6c6-41b2-95bc-29caa18ffc48 tempest-GroupSnapshotsTest-1329754185 None] Created reservations ['f1c7f69e-67fa-431d-aecc-f49ea920ae37', '39195a91-6166-4468-84e3-7cfb58661834', '2dd77c41-1e79-48b1-9b84-e6b6bc91898c', '996a5bf2-3cd1-4cde-9adb-ced2eaeac1aa'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:40:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ff4ec371-b6c6-41b2-95bc-29caa18ffc48 tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:40:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ff4ec371-b6c6-41b2-95bc-29caa18ffc48 tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:40:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ff4ec371-b6c6-41b2-95bc-29caa18ffc48 tempest-GroupSnapshotsTest-1329754185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:40:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ff4ec371-b6c6-41b2-95bc-29caa18ffc48 tempest-GroupSnapshotsTest-1329754185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:40:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ff4ec371-b6c6-41b2-95bc-29caa18ffc48 tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:40:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ff4ec371-b6c6-41b2-95bc-29caa18ffc48 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:18 devstack sudo[97369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:40:18 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:18 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ff4ec371-b6c6-41b2-95bc-29caa18ffc48 tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.350s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:18 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-ff4ec371-b6c6-41b2-95bc-29caa18ffc48 tempest-GroupSnapshotsTest-1329754185 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:40:18 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ff4ec371-b6c6-41b2-95bc-29caa18ffc48 tempest-GroupSnapshotsTest-1329754185 None] Delete group completed successfully. Sep 05 11:40:18 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6da500a4-eb87-4298-8b06-46e942d99c28 tempest-GroupSnapshotsTest-1329754185 None] Group tempest-GroupSnapshotsTest-Group-1460404506: creating Sep 05 11:40:18 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6da500a4-eb87-4298-8b06-46e942d99c28 tempest-GroupSnapshotsTest-1329754185 None] Group tempest-GroupSnapshotsTest-Group-1460404506: created successfully Sep 05 11:40:18 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6da500a4-eb87-4298-8b06-46e942d99c28 tempest-GroupSnapshotsTest-1329754185 None] Create group completed successfully. Sep 05 11:40:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-89747938-56af-42ff-b71d-e202151f8380 tempest-VolumesMetadataTest-1607197852 None] Acquiring lock "cinder-88279242-9467-40bb-958b-8ce995efc6a0-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:40:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-89747938-56af-42ff-b71d-e202151f8380 tempest-VolumesMetadataTest-1607197852 None] Lock "cinder-88279242-9467-40bb-958b-8ce995efc6a0-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:40:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-89747938-56af-42ff-b71d-e202151f8380 tempest-VolumesMetadataTest-1607197852 None] Acquiring lock "cinder-quobyte-88279242-9467-40bb-958b-8ce995efc6a0" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:40:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-89747938-56af-42ff-b71d-e202151f8380 tempest-VolumesMetadataTest-1607197852 None] Lock "cinder-quobyte-88279242-9467-40bb-958b-8ce995efc6a0" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:40:19 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12098fb-c4e2-419b-ae86-cb637b4a54b5]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:40:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-89747938-56af-42ff-b71d-e202151f8380 tempest-VolumesMetadataTest-1607197852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-88279242-9467-40bb-958b-8ce995efc6a0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:19 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-88279242-9467-40bb-958b-8ce995efc6a0 Sep 05 11:40:19 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:20 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-89747938-56af-42ff-b71d-e202151f8380 tempest-VolumesMetadataTest-1607197852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-88279242-9467-40bb-958b-8ce995efc6a0" returned: 0 in 0.401s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-89747938-56af-42ff-b71d-e202151f8380 tempest-VolumesMetadataTest-1607197852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-88279242-9467-40bb-958b-8ce995efc6a0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:20 devstack sudo[97397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-88279242-9467-40bb-958b-8ce995efc6a0 Sep 05 11:40:20 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:20 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-89747938-56af-42ff-b71d-e202151f8380 tempest-VolumesMetadataTest-1607197852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-88279242-9467-40bb-958b-8ce995efc6a0" returned: 0 in 0.290s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-89747938-56af-42ff-b71d-e202151f8380 tempest-VolumesMetadataTest-1607197852 None] Lock "cinder-quobyte-88279242-9467-40bb-958b-8ce995efc6a0" released by "delete_volume" :: held 0.744s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-89747938-56af-42ff-b71d-e202151f8380 tempest-VolumesMetadataTest-1607197852 None] Created reservations ['2f40d3d8-f281-4e5e-a95e-e185138d7ccc', '6b959994-ac51-4abf-b374-18105934ca82', '287ade69-c89b-49cf-954f-fc8fcd885bf7', '22be8f0c-6d99-4cee-9a87-6b0da5a66a48'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] Flow 'volume_create_manager' (f1472a2d-9e32-4b91-b0ff-f06214b2248e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d839bc50-e7f4-49ad-8aff-7e6397412b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d839bc50-e7f4-49ad-8aff-7e6397412b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1706293033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4fdfc2c9-4bf0-4f5c-a7d8-9a70a5a0d5c9,host='devstack@QuobyteHD#QuobyteHD',id=cd064f3f-1d28-4c51-8c89-d34bfafee601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4079d39981204503bfd20ba7cc776fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:40:21Z,use_quota=True,user_id='588c3314c4e3499dbe1b69e79f149fdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3265f9a-5f19-4228-8015-056ec6ff8027),volume_type_id=f3265f9a-5f19-4228-8015-056ec6ff8027)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8476a9de-ef4b-421a-b485-65c3496d7aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8476a9de-ef4b-421a-b485-65c3496d7aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a758d3-0b4f-4dd5-a5ed-2939ec6986eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a758d3-0b4f-4dd5-a5ed-2939ec6986eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd064f3f-1d28-4c51-8c89-d34bfafee601', 'volume_name': 'volume-cd064f3f-1d28-4c51-8c89-d34bfafee601', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e55c229a-e617-402c-a7cf-fcb9cfd5b2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e55c229a-e617-402c-a7cf-fcb9cfd5b2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20b14315-9c31-4c49-891b-043fa26ccc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:20 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] Volume cd064f3f-1d28-4c51-8c89-d34bfafee601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd064f3f-1d28-4c51-8c89-d34bfafee601', 'volume_size': 1} Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4fdfc2c9-4bf0-4f5c-a7d8-9a70a5a0d5c9,created_at=2026-09-05T09:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1706293033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4fdfc2c9-4bf0-4f5c-a7d8-9a70a5a0d5c9,host='devstack@QuobyteHD#QuobyteHD',id=cd064f3f-1d28-4c51-8c89-d34bfafee601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4079d39981204503bfd20ba7cc776fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:40:21Z,use_quota=True,user_id='588c3314c4e3499dbe1b69e79f149fdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3265f9a-5f19-4228-8015-056ec6ff8027),volume_type_id=f3265f9a-5f19-4228-8015-056ec6ff8027)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] Creating volume cd064f3f-1d28-4c51-8c89-d34bfafee601 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:40:20 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:20 devstack sudo[97400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601 1073741824 Sep 05 11:40:20 devstack sudo[97400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-89747938-56af-42ff-b71d-e202151f8380 tempest-VolumesMetadataTest-1607197852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-89747938-56af-42ff-b71d-e202151f8380 tempest-VolumesMetadataTest-1607197852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-89747938-56af-42ff-b71d-e202151f8380 tempest-VolumesMetadataTest-1607197852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-89747938-56af-42ff-b71d-e202151f8380 tempest-VolumesMetadataTest-1607197852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-89747938-56af-42ff-b71d-e202151f8380 tempest-VolumesMetadataTest-1607197852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:40:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-89747938-56af-42ff-b71d-e202151f8380 tempest-VolumesMetadataTest-1607197852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:20 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:40:20 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:21 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-89747938-56af-42ff-b71d-e202151f8380 tempest-VolumesMetadataTest-1607197852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.277s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:21 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-89747938-56af-42ff-b71d-e202151f8380 tempest-VolumesMetadataTest-1607197852 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:40:21 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-89747938-56af-42ff-b71d-e202151f8380 tempest-VolumesMetadataTest-1607197852 None] Deleted volume successfully. Sep 05 11:40:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-89747938-56af-42ff-b71d-e202151f8380 tempest-VolumesMetadataTest-1607197852 None] Lock "cinder-88279242-9467-40bb-958b-8ce995efc6a0-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:40:21 devstack sudo[97400]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601 1073741824" returned: 0 in 0.567s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:21 devstack sudo[97410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601 Sep 05 11:40:21 devstack sudo[97410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:21 devstack sudo[97410]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601" returned: 0 in 0.253s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:40:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:40:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20b14315-9c31-4c49-891b-043fa26ccc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd064f3f-1d28-4c51-8c89-d34bfafee601', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a094a2d-7d90-464c-a486-64f2d4ef5d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:21 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] Volume volume-cd064f3f-1d28-4c51-8c89-d34bfafee601 (cd064f3f-1d28-4c51-8c89-d34bfafee601): created successfully Sep 05 11:40:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a094a2d-7d90-464c-a486-64f2d4ef5d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] Flow 'volume_create_manager' (f1472a2d-9e32-4b91-b0ff-f06214b2248e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:40:21 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e25e8e45-7868-489b-a5ea-66cfa84d79e9 tempest-GroupSnapshotsTest-1329754185 None] Created volume successfully. Sep 05 11:40:21 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-fed47d7f-6078-4b3c-9bec-3313c8703286 tempest-GroupSnapshotsTest-1329754185 None] GroupSnapshot f16803c1-9254-495d-bb52-1f95bfced683: creating. Sep 05 11:40:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fed47d7f-6078-4b3c-9bec-3313c8703286 tempest-GroupSnapshotsTest-1329754185 None] Group snapshot f16803c1-9254-495d-bb52-1f95bfced683: creating. {{(pid=87517) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 05 11:40:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fed47d7f-6078-4b3c-9bec-3313c8703286 tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:40:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fed47d7f-6078-4b3c-9bec-3313c8703286 tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:40:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-fed47d7f-6078-4b3c-9bec-3313c8703286 tempest-GroupSnapshotsTest-1329754185 None] Creating offline snapshot 389da831-5934-43a6-80be-c8ca9bb94b73 of volume cd064f3f-1d28-4c51-8c89-d34bfafee601 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:40:22 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c821c3b-f6df-4791-934b-52be5b2d5114]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:40:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fed47d7f-6078-4b3c-9bec-3313c8703286 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:22 devstack sudo[97415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601 Sep 05 11:40:22 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:22 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fed47d7f-6078-4b3c-9bec-3313c8703286 tempest-GroupSnapshotsTest-1329754185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601" returned: 0 in 0.413s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fed47d7f-6078-4b3c-9bec-3313c8703286 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601.389da831-5934-43a6-80be-c8ca9bb94b73 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:22 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601.389da831-5934-43a6-80be-c8ca9bb94b73 1G Sep 05 11:40:22 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:22 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fed47d7f-6078-4b3c-9bec-3313c8703286 tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601.389da831-5934-43a6-80be-c8ca9bb94b73 1G" returned: 0 in 0.430s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fed47d7f-6078-4b3c-9bec-3313c8703286 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd064f3f-1d28-4c51-8c89-d34bfafee601 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601.389da831-5934-43a6-80be-c8ca9bb94b73 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:22 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd064f3f-1d28-4c51-8c89-d34bfafee601 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601.389da831-5934-43a6-80be-c8ca9bb94b73 Sep 05 11:40:22 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:23 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fed47d7f-6078-4b3c-9bec-3313c8703286 tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd064f3f-1d28-4c51-8c89-d34bfafee601 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601.389da831-5934-43a6-80be-c8ca9bb94b73" returned: 0 in 0.336s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:23 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-fed47d7f-6078-4b3c-9bec-3313c8703286 tempest-GroupSnapshotsTest-1329754185 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601.389da831-5934-43a6-80be-c8ca9bb94b73 is being set with open permissions: ugo+rw: NotImplementedError Sep 05 11:40:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fed47d7f-6078-4b3c-9bec-3313c8703286 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601.389da831-5934-43a6-80be-c8ca9bb94b73 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:23 devstack sudo[97430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601.389da831-5934-43a6-80be-c8ca9bb94b73 Sep 05 11:40:23 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:23 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fed47d7f-6078-4b3c-9bec-3313c8703286 tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601.389da831-5934-43a6-80be-c8ca9bb94b73" returned: 0 in 0.264s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fed47d7f-6078-4b3c-9bec-3313c8703286 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:23 devstack sudo[97457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601.info Sep 05 11:40:23 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:23 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fed47d7f-6078-4b3c-9bec-3313c8703286 tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601.info" returned: 0 in 0.266s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:23 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-fed47d7f-6078-4b3c-9bec-3313c8703286 tempest-GroupSnapshotsTest-1329754185 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601.info is being set with open permissions: ugo+rw: NotImplementedError Sep 05 11:40:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fed47d7f-6078-4b3c-9bec-3313c8703286 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:23 devstack sudo[97460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601.info Sep 05 11:40:23 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:24 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fed47d7f-6078-4b3c-9bec-3313c8703286 tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601.info" returned: 0 in 0.259s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fed47d7f-6078-4b3c-9bec-3313c8703286 tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.066s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:40:24 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-fed47d7f-6078-4b3c-9bec-3313c8703286 tempest-GroupSnapshotsTest-1329754185 None] group_snapshot f16803c1-9254-495d-bb52-1f95bfced683: created successfully Sep 05 11:40:24 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:40:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] Flow 'volume_create_manager' (19416acd-58a1-4925-bce6-f72f80eb40e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:40:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6bcf7e-a187-4ae9-94d9-7e7078d1813e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6bcf7e-a187-4ae9-94d9-7e7078d1813e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-203944782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4009291-ae2e-4a65-b809-f7f0f08ccff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2359b835d14903a317b058407fd3cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:40:25Z,use_quota=True,user_id='dc08a69b8e1d44bda084e6cc9b594ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea022698-6462-45c3-99ed-3ecc1d06034b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea022698-6462-45c3-99ed-3ecc1d06034b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c85f635-6278-4c34-851c-6c7fda3753bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c85f635-6278-4c34-851c-6c7fda3753bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4009291-ae2e-4a65-b809-f7f0f08ccff4', 'volume_name': 'volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b6b4fd7-3b43-4ebe-92a4-6197184d4c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b6b4fd7-3b43-4ebe-92a4-6197184d4c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4006860-dc65-4c3a-beaf-45736af26f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:25 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] Volume e4009291-ae2e-4a65-b809-f7f0f08ccff4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4', 'volume_size': 1} Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-203944782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4009291-ae2e-4a65-b809-f7f0f08ccff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2359b835d14903a317b058407fd3cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:40:25Z,use_quota=True,user_id='dc08a69b8e1d44bda084e6cc9b594ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] Creating volume e4009291-ae2e-4a65-b809-f7f0f08ccff4 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:40:25 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:25 devstack sudo[97478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4 1073741824 Sep 05 11:40:25 devstack sudo[97478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:25 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2ab5d0f1-d7dc-4b61-acb3-ffdfa0c1614b tempest-GroupSnapshotsTest-1329754185 None] group_snapshot f16803c1-9254-495d-bb52-1f95bfced683: deleting Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2ab5d0f1-d7dc-4b61-acb3-ffdfa0c1614b tempest-GroupSnapshotsTest-1329754185 None] group_snapshot f16803c1-9254-495d-bb52-1f95bfced683: deleting {{(pid=87517) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2ab5d0f1-d7dc-4b61-acb3-ffdfa0c1614b tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "cinder-quobyte-cd064f3f-1d28-4c51-8c89-d34bfafee601" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2ab5d0f1-d7dc-4b61-acb3-ffdfa0c1614b tempest-GroupSnapshotsTest-1329754185 None] Lock "cinder-quobyte-cd064f3f-1d28-4c51-8c89-d34bfafee601" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2ab5d0f1-d7dc-4b61-acb3-ffdfa0c1614b tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "cinder-quobyte-389da831-5934-43a6-80be-c8ca9bb94b73" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2ab5d0f1-d7dc-4b61-acb3-ffdfa0c1614b tempest-GroupSnapshotsTest-1329754185 None] Lock "cinder-quobyte-389da831-5934-43a6-80be-c8ca9bb94b73" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-2ab5d0f1-d7dc-4b61-acb3-ffdfa0c1614b tempest-GroupSnapshotsTest-1329754185 None] Deleting offline snapshot 389da831-5934-43a6-80be-c8ca9bb94b73 of volume cd064f3f-1d28-4c51-8c89-d34bfafee601 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-2ab5d0f1-d7dc-4b61-acb3-ffdfa0c1614b tempest-GroupSnapshotsTest-1329754185 None] snapshot_file for this snap is: volume-cd064f3f-1d28-4c51-8c89-d34bfafee601.389da831-5934-43a6-80be-c8ca9bb94b73 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:40:25 devstack sudo[97478]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4 1073741824" returned: 0 in 0.546s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2dded7-85bc-4ee8-b986-7322a7c65709]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2ab5d0f1-d7dc-4b61-acb3-ffdfa0c1614b tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601.389da831-5934-43a6-80be-c8ca9bb94b73 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:25 devstack sudo[97485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4 Sep 05 11:40:25 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:25 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601.389da831-5934-43a6-80be-c8ca9bb94b73 Sep 05 11:40:25 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:25 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4" returned: 0 in 0.305s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4006860-dc65-4c3a-beaf-45736af26f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e66ad7e6-544a-447f-802e-ec94856b6272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:25 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2ab5d0f1-d7dc-4b61-acb3-ffdfa0c1614b tempest-GroupSnapshotsTest-1329754185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601.389da831-5934-43a6-80be-c8ca9bb94b73" returned: 0 in 0.400s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-2ab5d0f1-d7dc-4b61-acb3-ffdfa0c1614b tempest-GroupSnapshotsTest-1329754185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd064f3f-1d28-4c51-8c89-d34bfafee601(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:40:26 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] Volume volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4 (e4009291-ae2e-4a65-b809-f7f0f08ccff4): created successfully Sep 05 11:40:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e66ad7e6-544a-447f-802e-ec94856b6272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] Flow 'volume_create_manager' (19416acd-58a1-4925-bce6-f72f80eb40e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:40:26 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6058468-6e02-4863-9ca9-b13e1089557f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:40:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2ab5d0f1-d7dc-4b61-acb3-ffdfa0c1614b tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:26 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7e7ddf11-2005-4821-b9ba-114412b526ea tempest-VolumesCloneTest-286736541 None] Created volume successfully. Sep 05 11:40:26 devstack sudo[97492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601 Sep 05 11:40:26 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:26 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2ab5d0f1-d7dc-4b61-acb3-ffdfa0c1614b tempest-GroupSnapshotsTest-1329754185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601" returned: 0 in 0.339s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2ab5d0f1-d7dc-4b61-acb3-ffdfa0c1614b tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601.389da831-5934-43a6-80be-c8ca9bb94b73 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:26 devstack sudo[97497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601.389da831-5934-43a6-80be-c8ca9bb94b73 Sep 05 11:40:26 devstack sudo[97497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:26 devstack sudo[97497]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2ab5d0f1-d7dc-4b61-acb3-ffdfa0c1614b tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601.389da831-5934-43a6-80be-c8ca9bb94b73" returned: 0 in 0.344s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2ab5d0f1-d7dc-4b61-acb3-ffdfa0c1614b tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601.389da831-5934-43a6-80be-c8ca9bb94b73 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:26 devstack sudo[97502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601.389da831-5934-43a6-80be-c8ca9bb94b73 Sep 05 11:40:26 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:26 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2ab5d0f1-d7dc-4b61-acb3-ffdfa0c1614b tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601.389da831-5934-43a6-80be-c8ca9bb94b73" returned: 0 in 0.251s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2ab5d0f1-d7dc-4b61-acb3-ffdfa0c1614b tempest-GroupSnapshotsTest-1329754185 None] Lock "cinder-quobyte-389da831-5934-43a6-80be-c8ca9bb94b73" released by "_delete_snapshot" :: held 1.438s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:40:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2ab5d0f1-d7dc-4b61-acb3-ffdfa0c1614b tempest-GroupSnapshotsTest-1329754185 None] Lock "cinder-quobyte-cd064f3f-1d28-4c51-8c89-d34bfafee601" released by "delete_snapshot" :: held 1.467s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:40:27 devstack cinder-volume[87517]: WARNING cinder.quota [None req-2ab5d0f1-d7dc-4b61-acb3-ffdfa0c1614b tempest-GroupSnapshotsTest-1329754185 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-972289902 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-972289902, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:40:27 devstack cinder-volume[87517]: WARNING cinder.quota [None req-2ab5d0f1-d7dc-4b61-acb3-ffdfa0c1614b tempest-GroupSnapshotsTest-1329754185 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-972289902 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-972289902, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:40:27 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-2ab5d0f1-d7dc-4b61-acb3-ffdfa0c1614b tempest-GroupSnapshotsTest-1329754185 None] Created reservations ['3e9011fa-974b-4230-adf3-18ff015d9514', '09d3092f-fdf6-4d1b-b444-ffc312047695', '91f4f31d-9df5-4812-9192-db488e94c384', 'b4ba06c3-0673-4f39-b8a3-10e214ddd129'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:40:27 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2ab5d0f1-d7dc-4b61-acb3-ffdfa0c1614b tempest-GroupSnapshotsTest-1329754185 None] group_snapshot f16803c1-9254-495d-bb52-1f95bfced683: deleted successfully Sep 05 11:40:27 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:40:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Flow 'volume_create_manager' (36156d27-3ca2-4d29-969f-e417f11de69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:40:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd6cadab-5e16-4ed0-b552-d628ae73be8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd6cadab-5e16-4ed0-b552-d628ae73be8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-203052657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12d7503f-e8be-4365-9e68-d67edaf2c12a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2359b835d14903a317b058407fd3cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:40:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=e4009291-ae2e-4a65-b809-f7f0f08ccff4,status='creating',terminated_at=None,updated_at=2026-09-05T09:40:27Z,use_quota=True,user_id='dc08a69b8e1d44bda084e6cc9b594ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfcd66bf-4db7-4a95-bdcb-1934433f9017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfcd66bf-4db7-4a95-bdcb-1934433f9017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c48187e5-82da-4408-bc4e-55cfbba66b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c48187e5-82da-4408-bc4e-55cfbba66b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '12d7503f-e8be-4365-9e68-d67edaf2c12a', 'volume_name': 'volume-12d7503f-e8be-4365-9e68-d67edaf2c12a', 'volume_size': 2, 'source_volid': 'e4009291-ae2e-4a65-b809-f7f0f08ccff4', 'source_volstatus': 'available'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3f1f90e-8690-4377-9794-2a94c5ce083b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3f1f90e-8690-4377-9794-2a94c5ce083b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68bbb850-7bc4-490b-bad8-b13a903eaab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:27 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Volume 12d7503f-e8be-4365-9e68-d67edaf2c12a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-12d7503f-e8be-4365-9e68-d67edaf2c12a', 'volume_size': 2, 'source_volid': 'e4009291-ae2e-4a65-b809-f7f0f08ccff4', 'source_volstatus': 'available'} Sep 05 11:40:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:40:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:40:27 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Cloning volume e4009291-ae2e-4a65-b809-f7f0f08ccff4 to volume 12d7503f-e8be-4365-9e68-d67edaf2c12a Sep 05 11:40:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Creating offline snapshot d731e956-fd02-4d94-9430-440c77065573 of volume e4009291-ae2e-4a65-b809-f7f0f08ccff4 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:40:27 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec2b4c4-928e-4853-bb5a-64858096a8d4]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:40:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:27 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4 Sep 05 11:40:27 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:27 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4" returned: 0 in 0.364s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4.d731e956-fd02-4d94-9430-440c77065573 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:28 devstack sudo[97510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4.d731e956-fd02-4d94-9430-440c77065573 1G Sep 05 11:40:28 devstack sudo[97510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a8a4959a-8126-4712-9950-08331b139656 tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "cinder-quobyte-cd064f3f-1d28-4c51-8c89-d34bfafee601" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:40:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a8a4959a-8126-4712-9950-08331b139656 tempest-GroupSnapshotsTest-1329754185 None] Lock "cinder-quobyte-cd064f3f-1d28-4c51-8c89-d34bfafee601" acquired by "delete_volume" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:40:28 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7dc5651-f097-4cfa-8bac-c154d6b21b14]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:40:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a8a4959a-8126-4712-9950-08331b139656 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:28 devstack sudo[97525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601 Sep 05 11:40:28 devstack sudo[97525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:28 devstack sudo[97510]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4.d731e956-fd02-4d94-9430-440c77065573 1G" returned: 0 in 0.449s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4.d731e956-fd02-4d94-9430-440c77065573 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:28 devstack sudo[97553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4.d731e956-fd02-4d94-9430-440c77065573 Sep 05 11:40:28 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:28 devstack sudo[97525]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a8a4959a-8126-4712-9950-08331b139656 tempest-GroupSnapshotsTest-1329754185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601" returned: 0 in 0.429s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a8a4959a-8126-4712-9950-08331b139656 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:28 devstack sudo[97560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601 Sep 05 11:40:28 devstack sudo[97560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:28 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4.d731e956-fd02-4d94-9430-440c77065573" returned: 0 in 0.294s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:28 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4.d731e956-fd02-4d94-9430-440c77065573 is being set with open permissions: ugo+rw Sep 05 11:40:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4.d731e956-fd02-4d94-9430-440c77065573 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:28 devstack sudo[97565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4.d731e956-fd02-4d94-9430-440c77065573 Sep 05 11:40:28 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:28 devstack sudo[97560]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a8a4959a-8126-4712-9950-08331b139656 tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cd064f3f-1d28-4c51-8c89-d34bfafee601" returned: 0 in 0.249s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a8a4959a-8126-4712-9950-08331b139656 tempest-GroupSnapshotsTest-1329754185 None] Lock "cinder-quobyte-cd064f3f-1d28-4c51-8c89-d34bfafee601" released by "delete_volume" :: held 0.762s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:40:28 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-a8a4959a-8126-4712-9950-08331b139656 tempest-GroupSnapshotsTest-1329754185 None] Created reservations ['6c4cfa8f-cd6f-4c05-8f6b-537158e1a68f'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:40:28 devstack cinder-volume[87517]: WARNING cinder.quota [None req-a8a4959a-8126-4712-9950-08331b139656 tempest-GroupSnapshotsTest-1329754185 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-972289902 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-972289902, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:40:28 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-a8a4959a-8126-4712-9950-08331b139656 tempest-GroupSnapshotsTest-1329754185 None] Created reservations ['ae4c5d25-0e48-4558-b0d1-1d1bf3dd7794', 'b30e3806-6663-479e-a66d-e85b5d275d3a', '47fd9443-fcaa-45c1-9062-b5d53781fa62', 'f81cdc74-c76e-4d04-a1e0-78238ef00666'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:40:28 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4.d731e956-fd02-4d94-9430-440c77065573" returned: 0 in 0.261s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:29 devstack sudo[97569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4.info Sep 05 11:40:29 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a8a4959a-8126-4712-9950-08331b139656 tempest-GroupSnapshotsTest-1329754185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:40:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a8a4959a-8126-4712-9950-08331b139656 tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:40:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a8a4959a-8126-4712-9950-08331b139656 tempest-GroupSnapshotsTest-1329754185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:40:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a8a4959a-8126-4712-9950-08331b139656 tempest-GroupSnapshotsTest-1329754185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:40:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a8a4959a-8126-4712-9950-08331b139656 tempest-GroupSnapshotsTest-1329754185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:40:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a8a4959a-8126-4712-9950-08331b139656 tempest-GroupSnapshotsTest-1329754185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:29 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:40:29 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:29 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4.info" returned: 0 in 0.266s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:29 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4.info is being set with open permissions: ugo+rw Sep 05 11:40:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:29 devstack sudo[97574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4.info Sep 05 11:40:29 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:29 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a8a4959a-8126-4712-9950-08331b139656 tempest-GroupSnapshotsTest-1329754185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.260s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:29 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-a8a4959a-8126-4712-9950-08331b139656 tempest-GroupSnapshotsTest-1329754185 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:40:29 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a8a4959a-8126-4712-9950-08331b139656 tempest-GroupSnapshotsTest-1329754185 None] Delete group completed successfully. Sep 05 11:40:29 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4.info" returned: 0 in 0.268s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Acquiring lock "cinder-quobyte-12d7503f-e8be-4365-9e68-d67edaf2c12a" by "_copy_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:40:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Lock "cinder-quobyte-12d7503f-e8be-4365-9e68-d67edaf2c12a" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:40:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] snapshot: d731e956-fd02-4d94-9430-440c77065573, volume: 12d7503f-e8be-4365-9e68-d67edaf2c12a, {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 11:40:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:40:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:40:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:40:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:40:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:40:29 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcc03c0-cf15-4830-bed9-2aed15725db9]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:40:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4.d731e956-fd02-4d94-9430-440c77065573 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:29 devstack sudo[97578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4.d731e956-fd02-4d94-9430-440c77065573 Sep 05 11:40:29 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:29 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4.d731e956-fd02-4d94-9430-440c77065573" returned: 0 in 0.377s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:40:30 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8112f51-bf9a-4d50-9496-3e43db7489fe]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:40:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:30 devstack sudo[97585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4 Sep 05 11:40:30 devstack sudo[97585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:30 devstack sudo[97585]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4" returned: 0 in 0.465s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4 {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 11:40:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Creating direct copy from snapshot {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 11:40:30 devstack cinder-volume[87517]: DEBUG cinder.utils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Path /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-12d7503f-e8be-4365-9e68-d67edaf2c12a not found in is_blk_device check {{(pid=87517) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 11:40:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-12d7503f-e8be-4365-9e68-d67edaf2c12a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:30 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-12d7503f-e8be-4365-9e68-d67edaf2c12a Sep 05 11:40:30 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:31 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:40:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] Flow 'volume_create_manager' (a5117135-3c42-4060-afe1-bee7e76b7f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:40:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5815c761-e7f3-44fe-91c5-0f2afc08679e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5815c761-e7f3-44fe-91c5-0f2afc08679e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1745353299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0536bbb-2aa0-496b-b986-dcde56ad512c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c878f179b2d443908f5e69ae85f6a12d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:40:31Z,use_quota=True,user_id='56a4a548fd774fbd8eddf862e4f2abf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1cda7b1-2317-4d94-9220-e6ff70e174f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1cda7b1-2317-4d94-9220-e6ff70e174f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0279e36e-e73f-4bea-b1e7-3e27f5f3257d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0279e36e-e73f-4bea-b1e7-3e27f5f3257d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0536bbb-2aa0-496b-b986-dcde56ad512c', 'volume_name': 'volume-b0536bbb-2aa0-496b-b986-dcde56ad512c', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f838e833-32d4-480c-b70b-cf53f6c5d67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f838e833-32d4-480c-b70b-cf53f6c5d67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (094815a3-1584-4afb-9966-36e56b56a35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:31 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] Volume b0536bbb-2aa0-496b-b986-dcde56ad512c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0536bbb-2aa0-496b-b986-dcde56ad512c', 'volume_size': 1} Sep 05 11:40:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:40:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:40:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:40:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:40:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:40:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:40:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:40:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:32 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:40:32 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:32 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.576s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:32 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:40:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:40:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread count: 28 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 11:40:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread info: [<_MainThread(MainThread, started 131707869511808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 11:40:36 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-12d7503f-e8be-4365-9e68-d67edaf2c12a" returned: 0 in 5.641s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:36 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Image conversion details: src /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4, size 1024.00 MB, duration 5.64 sec, destination /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-12d7503f-e8be-4365-9e68-d67edaf2c12a {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 11:40:36 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Converted 1024.00 MB image at 181.50 MB/s Sep 05 11:40:36 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-12d7503f-e8be-4365-9e68-d67edaf2c12a is being set with open permissions: ugo+rw Sep 05 11:40:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-12d7503f-e8be-4365-9e68-d67edaf2c12a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:36 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-12d7503f-e8be-4365-9e68-d67edaf2c12a Sep 05 11:40:36 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:36 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-12d7503f-e8be-4365-9e68-d67edaf2c12a" returned: 0 in 0.240s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Lock "cinder-quobyte-12d7503f-e8be-4365-9e68-d67edaf2c12a" released by "_copy_volume_from_snapshot" :: held 6.790s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:40:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Acquiring lock "cinder-quobyte-d731e956-fd02-4d94-9430-440c77065573" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:40:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Lock "cinder-quobyte-d731e956-fd02-4d94-9430-440c77065573" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:40:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Deleting offline snapshot d731e956-fd02-4d94-9430-440c77065573 of volume e4009291-ae2e-4a65-b809-f7f0f08ccff4 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:40:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] snapshot_file for this snap is: volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4.d731e956-fd02-4d94-9430-440c77065573 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:40:36 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdf550d-5fcc-40bc-bfb2-f86e63b60756]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:40:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4.d731e956-fd02-4d94-9430-440c77065573 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:36 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4.d731e956-fd02-4d94-9430-440c77065573 Sep 05 11:40:36 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:36 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4.d731e956-fd02-4d94-9430-440c77065573" returned: 0 in 0.342s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:40:36 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf59c7cc-7dfc-4174-9299-94209cd132cc]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:40:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:36 devstack sudo[97630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4 Sep 05 11:40:36 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:37 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4" returned: 0 in 0.523s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4.d731e956-fd02-4d94-9430-440c77065573 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:37 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4.d731e956-fd02-4d94-9430-440c77065573 Sep 05 11:40:37 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:37 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4.d731e956-fd02-4d94-9430-440c77065573" returned: 0 in 0.338s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4.d731e956-fd02-4d94-9430-440c77065573 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:37 devstack sudo[97640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4.d731e956-fd02-4d94-9430-440c77065573 Sep 05 11:40:37 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:37 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4.d731e956-fd02-4d94-9430-440c77065573" returned: 0 in 0.242s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Lock "cinder-quobyte-d731e956-fd02-4d94-9430-440c77065573" released by "_delete_snapshot" :: held 1.531s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:40:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.396s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:40:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.617s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:40:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1745353299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0536bbb-2aa0-496b-b986-dcde56ad512c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c878f179b2d443908f5e69ae85f6a12d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:40:31Z,use_quota=True,user_id='56a4a548fd774fbd8eddf862e4f2abf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:40:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] Creating volume b0536bbb-2aa0-496b-b986-dcde56ad512c {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:40:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:40:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:40:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:40:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:40:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:40:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:40:37 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:40:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b0536bbb-2aa0-496b-b986-dcde56ad512c 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68bbb850-7bc4-490b-bad8-b13a903eaab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12d7503f-e8be-4365-9e68-d67edaf2c12a', 'volume_size': 2, 'source_volid': 'e4009291-ae2e-4a65-b809-f7f0f08ccff4', 'source_volstatus': 'available'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:38 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b0536bbb-2aa0-496b-b986-dcde56ad512c 1073741824 Sep 05 11:40:38 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (689b6699-2f2c-4179-8cf8-15df567ac163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:38 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Volume volume-12d7503f-e8be-4365-9e68-d67edaf2c12a (12d7503f-e8be-4365-9e68-d67edaf2c12a): created successfully Sep 05 11:40:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (689b6699-2f2c-4179-8cf8-15df567ac163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Flow 'volume_create_manager' (36156d27-3ca2-4d29-969f-e417f11de69b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:40:38 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-de9dd4d6-a278-49e2-b3a1-a2ef9479b94c tempest-VolumesCloneTest-286736541 None] Created volume successfully. Sep 05 11:40:38 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b0536bbb-2aa0-496b-b986-dcde56ad512c 1073741824" returned: 0 in 0.449s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b0536bbb-2aa0-496b-b986-dcde56ad512c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:38 devstack sudo[97649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b0536bbb-2aa0-496b-b986-dcde56ad512c Sep 05 11:40:38 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:38 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-47d1d928-70b1-43fc-be8f-62c6492edcc9 tempest-GroupSnapshotsV319Test-1907429282 None] Group tempest-GroupSnapshotsV319Test-Group-1611237566: creating Sep 05 11:40:38 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-47d1d928-70b1-43fc-be8f-62c6492edcc9 tempest-GroupSnapshotsV319Test-1907429282 None] Group tempest-GroupSnapshotsV319Test-Group-1611237566: created successfully Sep 05 11:40:38 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-47d1d928-70b1-43fc-be8f-62c6492edcc9 tempest-GroupSnapshotsV319Test-1907429282 None] Create group completed successfully. Sep 05 11:40:38 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b0536bbb-2aa0-496b-b986-dcde56ad512c" returned: 0 in 0.250s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:40:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:40:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (094815a3-1584-4afb-9966-36e56b56a35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0536bbb-2aa0-496b-b986-dcde56ad512c', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa34baf-8b41-455e-b3b7-31db522f3d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:38 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] Volume volume-b0536bbb-2aa0-496b-b986-dcde56ad512c (b0536bbb-2aa0-496b-b986-dcde56ad512c): created successfully Sep 05 11:40:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa34baf-8b41-455e-b3b7-31db522f3d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] Flow 'volume_create_manager' (a5117135-3c42-4060-afe1-bee7e76b7f7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:40:38 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-171da8c8-3aab-49d1-b00d-5c2b2dadd538 tempest-AttachVolumeTestJSON-1706745870 None] Created volume successfully. Sep 05 11:40:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e6c6effc-b20f-418d-a7e4-faf1a218e3df tempest-VolumesCloneTest-286736541 None] Acquiring lock "cinder-12d7503f-e8be-4365-9e68-d67edaf2c12a-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:40:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e6c6effc-b20f-418d-a7e4-faf1a218e3df tempest-VolumesCloneTest-286736541 None] Lock "cinder-12d7503f-e8be-4365-9e68-d67edaf2c12a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:40:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e6c6effc-b20f-418d-a7e4-faf1a218e3df tempest-VolumesCloneTest-286736541 None] Acquiring lock "cinder-quobyte-12d7503f-e8be-4365-9e68-d67edaf2c12a" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:40:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e6c6effc-b20f-418d-a7e4-faf1a218e3df tempest-VolumesCloneTest-286736541 None] Lock "cinder-quobyte-12d7503f-e8be-4365-9e68-d67edaf2c12a" acquired by "delete_volume" :: waited 0.012s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:40:38 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df10862-381a-4068-a959-b3f20a782a51]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:40:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6c6effc-b20f-418d-a7e4-faf1a218e3df tempest-VolumesCloneTest-286736541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-12d7503f-e8be-4365-9e68-d67edaf2c12a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:38 devstack sudo[97652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-12d7503f-e8be-4365-9e68-d67edaf2c12a Sep 05 11:40:38 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:39 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6c6effc-b20f-418d-a7e4-faf1a218e3df tempest-VolumesCloneTest-286736541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-12d7503f-e8be-4365-9e68-d67edaf2c12a" returned: 0 in 0.361s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6c6effc-b20f-418d-a7e4-faf1a218e3df tempest-VolumesCloneTest-286736541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-12d7503f-e8be-4365-9e68-d67edaf2c12a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:39 devstack sudo[97657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-12d7503f-e8be-4365-9e68-d67edaf2c12a Sep 05 11:40:39 devstack sudo[97657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:39 devstack sudo[97657]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6c6effc-b20f-418d-a7e4-faf1a218e3df tempest-VolumesCloneTest-286736541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-12d7503f-e8be-4365-9e68-d67edaf2c12a" returned: 0 in 0.228s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e6c6effc-b20f-418d-a7e4-faf1a218e3df tempest-VolumesCloneTest-286736541 None] Lock "cinder-quobyte-12d7503f-e8be-4365-9e68-d67edaf2c12a" released by "delete_volume" :: held 0.624s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:40:39 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-e6c6effc-b20f-418d-a7e4-faf1a218e3df tempest-VolumesCloneTest-286736541 None] Created reservations ['9e08a8ce-0132-4e52-a885-63981d05d0a9', '9aec2b2d-073d-499a-b8c6-b42454189f7f', 'faf873e5-d235-4038-a08e-d9c98a0e5c0b', '1c0fbf2f-386b-4deb-a654-c5b0b8f5c04d'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:40:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e6c6effc-b20f-418d-a7e4-faf1a218e3df tempest-VolumesCloneTest-286736541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:40:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e6c6effc-b20f-418d-a7e4-faf1a218e3df tempest-VolumesCloneTest-286736541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:40:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e6c6effc-b20f-418d-a7e4-faf1a218e3df tempest-VolumesCloneTest-286736541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:40:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e6c6effc-b20f-418d-a7e4-faf1a218e3df tempest-VolumesCloneTest-286736541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:40:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e6c6effc-b20f-418d-a7e4-faf1a218e3df tempest-VolumesCloneTest-286736541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:40:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6c6effc-b20f-418d-a7e4-faf1a218e3df tempest-VolumesCloneTest-286736541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:39 devstack sudo[97660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:40:39 devstack sudo[97660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:39 devstack sudo[97660]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6c6effc-b20f-418d-a7e4-faf1a218e3df tempest-VolumesCloneTest-286736541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.267s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:39 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-e6c6effc-b20f-418d-a7e4-faf1a218e3df tempest-VolumesCloneTest-286736541 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:40:39 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e6c6effc-b20f-418d-a7e4-faf1a218e3df tempest-VolumesCloneTest-286736541 None] Deleted volume successfully. Sep 05 11:40:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e6c6effc-b20f-418d-a7e4-faf1a218e3df tempest-VolumesCloneTest-286736541 None] Lock "cinder-12d7503f-e8be-4365-9e68-d67edaf2c12a-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-726a6bd3-8483-40df-9904-c9df18c61842 tempest-VolumesCloneTest-286736541 None] Acquiring lock "cinder-e4009291-ae2e-4a65-b809-f7f0f08ccff4-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-726a6bd3-8483-40df-9904-c9df18c61842 tempest-VolumesCloneTest-286736541 None] Lock "cinder-e4009291-ae2e-4a65-b809-f7f0f08ccff4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-726a6bd3-8483-40df-9904-c9df18c61842 tempest-VolumesCloneTest-286736541 None] Acquiring lock "cinder-quobyte-e4009291-ae2e-4a65-b809-f7f0f08ccff4" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-726a6bd3-8483-40df-9904-c9df18c61842 tempest-VolumesCloneTest-286736541 None] Lock "cinder-quobyte-e4009291-ae2e-4a65-b809-f7f0f08ccff4" acquired by "delete_volume" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[80312056-0e9c-407f-89e3-a25a41d4db1a]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-726a6bd3-8483-40df-9904-c9df18c61842 tempest-VolumesCloneTest-286736541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] Flow 'volume_create_manager' (faf84acd-b5fe-4fc7-82b8-eedb603751ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26443960-1602-4e8c-8d1a-03be2fb53d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26443960-1602-4e8c-8d1a-03be2fb53d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1447567879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=77168054-bfac-44f2-8f7c-5585cc8f40ee,host='devstack@QuobyteHD#QuobyteHD',id=c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='376afb4e5fa54474b5ab724c8590986d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:40:40Z,use_quota=True,user_id='3e7e2a75e6994ee6b5fe1e39ee797811',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(019802f4-e1dc-4b16-9274-35cfb745e07c),volume_type_id=019802f4-e1dc-4b16-9274-35cfb745e07c)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (510e0520-0ffc-431f-acac-2e3817fed11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (510e0520-0ffc-431f-acac-2e3817fed11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3778221-7511-43ea-b3ef-9a9dc0ab96c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3778221-7511-43ea-b3ef-9a9dc0ab96c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3', 'volume_name': 'volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (799a69f3-d653-49b1-b6f9-235ca8bbca90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (799a69f3-d653-49b1-b6f9-235ca8bbca90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf107df5-9596-4707-bd60-0810747ca893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:40 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] Volume c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3', 'volume_size': 1} Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:40:40 devstack sudo[97666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4 Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=77168054-bfac-44f2-8f7c-5585cc8f40ee,created_at=2026-09-05T09:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1447567879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=77168054-bfac-44f2-8f7c-5585cc8f40ee,host='devstack@QuobyteHD#QuobyteHD',id=c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='376afb4e5fa54474b5ab724c8590986d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:40:40Z,use_quota=True,user_id='3e7e2a75e6994ee6b5fe1e39ee797811',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(019802f4-e1dc-4b16-9274-35cfb745e07c),volume_type_id=019802f4-e1dc-4b16-9274-35cfb745e07c)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:40:40 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] Creating volume c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:40:40 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:40 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3 1073741824 Sep 05 11:40:40 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-6993d9b0-fa2f-4252-8ff0-c591b14fa9ea req-b34f6da2-4028-44b9-8456-887a31399480 tempest-AttachVolumeTestJSON-1706745870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:40:40 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-726a6bd3-8483-40df-9904-c9df18c61842 tempest-VolumesCloneTest-286736541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4" returned: 0 in 0.430s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-726a6bd3-8483-40df-9904-c9df18c61842 tempest-VolumesCloneTest-286736541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:40 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4 Sep 05 11:40:40 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:40 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3 1073741824" returned: 0 in 0.439s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:40 devstack sudo[97686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3 Sep 05 11:40:40 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:40 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-726a6bd3-8483-40df-9904-c9df18c61842 tempest-VolumesCloneTest-286736541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4009291-ae2e-4a65-b809-f7f0f08ccff4" returned: 0 in 0.271s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-726a6bd3-8483-40df-9904-c9df18c61842 tempest-VolumesCloneTest-286736541 None] Lock "cinder-quobyte-e4009291-ae2e-4a65-b809-f7f0f08ccff4" released by "delete_volume" :: held 0.788s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:40:41 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-726a6bd3-8483-40df-9904-c9df18c61842 tempest-VolumesCloneTest-286736541 None] Created reservations ['cfa9ed33-8816-44c3-a54e-ebfda3c90cb4', 'c30b0182-8036-484d-bed4-851d4c968b24', 'c51866d6-babf-4054-8217-46f89347fa4d', '76ce0d0e-99f4-4d8d-aba8-8a935b970a7b'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:40:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-726a6bd3-8483-40df-9904-c9df18c61842 tempest-VolumesCloneTest-286736541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:40:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-726a6bd3-8483-40df-9904-c9df18c61842 tempest-VolumesCloneTest-286736541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:40:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-726a6bd3-8483-40df-9904-c9df18c61842 tempest-VolumesCloneTest-286736541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:40:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-726a6bd3-8483-40df-9904-c9df18c61842 tempest-VolumesCloneTest-286736541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:40:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-726a6bd3-8483-40df-9904-c9df18c61842 tempest-VolumesCloneTest-286736541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:40:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-726a6bd3-8483-40df-9904-c9df18c61842 tempest-VolumesCloneTest-286736541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:41 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:40:41 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:41 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3" returned: 0 in 0.253s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:40:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:40:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-6993d9b0-fa2f-4252-8ff0-c591b14fa9ea req-b34f6da2-4028-44b9-8456-887a31399480 tempest-AttachVolumeTestJSON-1706745870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.527s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:40:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf107df5-9596-4707-bd60-0810747ca893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a5454e1-499c-4f7d-af3f-73af84abdd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-6993d9b0-fa2f-4252-8ff0-c591b14fa9ea req-b34f6da2-4028-44b9-8456-887a31399480 tempest-AttachVolumeTestJSON-1706745870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:40:41 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] Volume volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3 (c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3): created successfully Sep 05 11:40:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a5454e1-499c-4f7d-af3f-73af84abdd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] Flow 'volume_create_manager' (faf84acd-b5fe-4fc7-82b8-eedb603751ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:40:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-6993d9b0-fa2f-4252-8ff0-c591b14fa9ea req-b34f6da2-4028-44b9-8456-887a31399480 tempest-AttachVolumeTestJSON-1706745870 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32', 'name': 'volume-b0536bbb-2aa0-496b-b986-dcde56ad512c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e61507fa-6559-41a8-a710-57c80ef47a2c', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 11:40:41 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e7266023-be92-4b4b-9710-d2c615d7726a tempest-GroupSnapshotsV319Test-1907429282 None] Created volume successfully. Sep 05 11:40:41 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-6993d9b0-fa2f-4252-8ff0-c591b14fa9ea req-b34f6da2-4028-44b9-8456-887a31399480 tempest-AttachVolumeTestJSON-1706745870 None] attachment_update completed successfully. Sep 05 11:40:41 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-726a6bd3-8483-40df-9904-c9df18c61842 tempest-VolumesCloneTest-286736541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.278s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:41 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-726a6bd3-8483-40df-9904-c9df18c61842 tempest-VolumesCloneTest-286736541 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:40:41 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-726a6bd3-8483-40df-9904-c9df18c61842 tempest-VolumesCloneTest-286736541 None] Deleted volume successfully. Sep 05 11:40:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-726a6bd3-8483-40df-9904-c9df18c61842 tempest-VolumesCloneTest-286736541 None] Lock "cinder-e4009291-ae2e-4a65-b809-f7f0f08ccff4-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:40:41 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3a4ee8af-b58d-4106-8082-baf0c4e89048 tempest-GroupSnapshotsV319Test-1907429282 None] GroupSnapshot 2c27afc3-73dc-4691-be64-4f614c492a15: creating. Sep 05 11:40:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3a4ee8af-b58d-4106-8082-baf0c4e89048 tempest-GroupSnapshotsV319Test-1907429282 None] Group snapshot 2c27afc3-73dc-4691-be64-4f614c492a15: creating. {{(pid=87517) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 05 11:40:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3a4ee8af-b58d-4106-8082-baf0c4e89048 tempest-GroupSnapshotsV319Test-1907429282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:40:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3a4ee8af-b58d-4106-8082-baf0c4e89048 tempest-GroupSnapshotsV319Test-1907429282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:40:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3a4ee8af-b58d-4106-8082-baf0c4e89048 tempest-GroupSnapshotsV319Test-1907429282 None] Creating offline snapshot 57924123-db11-466c-acb6-53360e3fe4ed of volume c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:40:41 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[37eb7e41-e1a7-4426-b5a9-55dbe3d4113f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:40:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a4ee8af-b58d-4106-8082-baf0c4e89048 tempest-GroupSnapshotsV319Test-1907429282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:42 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3 Sep 05 11:40:42 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:42 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a4ee8af-b58d-4106-8082-baf0c4e89048 tempest-GroupSnapshotsV319Test-1907429282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3" returned: 0 in 0.377s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a4ee8af-b58d-4106-8082-baf0c4e89048 tempest-GroupSnapshotsV319Test-1907429282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3.57924123-db11-466c-acb6-53360e3fe4ed 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:42 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3.57924123-db11-466c-acb6-53360e3fe4ed 1G Sep 05 11:40:42 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:42 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a4ee8af-b58d-4106-8082-baf0c4e89048 tempest-GroupSnapshotsV319Test-1907429282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3.57924123-db11-466c-acb6-53360e3fe4ed 1G" returned: 0 in 0.482s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a4ee8af-b58d-4106-8082-baf0c4e89048 tempest-GroupSnapshotsV319Test-1907429282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3.57924123-db11-466c-acb6-53360e3fe4ed {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:42 devstack sudo[97709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3.57924123-db11-466c-acb6-53360e3fe4ed Sep 05 11:40:42 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:43 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a4ee8af-b58d-4106-8082-baf0c4e89048 tempest-GroupSnapshotsV319Test-1907429282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3.57924123-db11-466c-acb6-53360e3fe4ed" returned: 0 in 0.456s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:43 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-3a4ee8af-b58d-4106-8082-baf0c4e89048 tempest-GroupSnapshotsV319Test-1907429282 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3.57924123-db11-466c-acb6-53360e3fe4ed is being set with open permissions: ugo+rw: NotImplementedError Sep 05 11:40:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a4ee8af-b58d-4106-8082-baf0c4e89048 tempest-GroupSnapshotsV319Test-1907429282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3.57924123-db11-466c-acb6-53360e3fe4ed {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:43 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3.57924123-db11-466c-acb6-53360e3fe4ed Sep 05 11:40:43 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:43 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a4ee8af-b58d-4106-8082-baf0c4e89048 tempest-GroupSnapshotsV319Test-1907429282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3.57924123-db11-466c-acb6-53360e3fe4ed" returned: 0 in 0.253s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a4ee8af-b58d-4106-8082-baf0c4e89048 tempest-GroupSnapshotsV319Test-1907429282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:43 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3.info Sep 05 11:40:43 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:43 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a4ee8af-b58d-4106-8082-baf0c4e89048 tempest-GroupSnapshotsV319Test-1907429282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3.info" returned: 0 in 0.245s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:43 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-3a4ee8af-b58d-4106-8082-baf0c4e89048 tempest-GroupSnapshotsV319Test-1907429282 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3.info is being set with open permissions: ugo+rw: NotImplementedError Sep 05 11:40:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a4ee8af-b58d-4106-8082-baf0c4e89048 tempest-GroupSnapshotsV319Test-1907429282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:43 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3.info Sep 05 11:40:43 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:44 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a4ee8af-b58d-4106-8082-baf0c4e89048 tempest-GroupSnapshotsV319Test-1907429282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3.info" returned: 0 in 0.259s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3a4ee8af-b58d-4106-8082-baf0c4e89048 tempest-GroupSnapshotsV319Test-1907429282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.166s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:40:44 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3a4ee8af-b58d-4106-8082-baf0c4e89048 tempest-GroupSnapshotsV319Test-1907429282 None] group_snapshot 2c27afc3-73dc-4691-be64-4f614c492a15: created successfully Sep 05 11:40:45 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-91fd8c1d-4884-4b46-8059-2741bae3c608 tempest-GroupSnapshotsV319Test-1907429282 None] group_snapshot 2c27afc3-73dc-4691-be64-4f614c492a15: deleting Sep 05 11:40:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-91fd8c1d-4884-4b46-8059-2741bae3c608 tempest-GroupSnapshotsV319Test-1907429282 None] group_snapshot 2c27afc3-73dc-4691-be64-4f614c492a15: deleting {{(pid=87517) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 05 11:40:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-91fd8c1d-4884-4b46-8059-2741bae3c608 tempest-GroupSnapshotsV319Test-1907429282 None] Acquiring lock "cinder-quobyte-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:40:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-91fd8c1d-4884-4b46-8059-2741bae3c608 tempest-GroupSnapshotsV319Test-1907429282 None] Lock "cinder-quobyte-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:40:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-91fd8c1d-4884-4b46-8059-2741bae3c608 tempest-GroupSnapshotsV319Test-1907429282 None] Acquiring lock "cinder-quobyte-57924123-db11-466c-acb6-53360e3fe4ed" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:40:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-91fd8c1d-4884-4b46-8059-2741bae3c608 tempest-GroupSnapshotsV319Test-1907429282 None] Lock "cinder-quobyte-57924123-db11-466c-acb6-53360e3fe4ed" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:40:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-91fd8c1d-4884-4b46-8059-2741bae3c608 tempest-GroupSnapshotsV319Test-1907429282 None] Deleting offline snapshot 57924123-db11-466c-acb6-53360e3fe4ed of volume c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:40:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-91fd8c1d-4884-4b46-8059-2741bae3c608 tempest-GroupSnapshotsV319Test-1907429282 None] snapshot_file for this snap is: volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3.57924123-db11-466c-acb6-53360e3fe4ed {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:40:46 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[9369f9c6-342d-4ef8-8577-f96052020803]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:40:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-91fd8c1d-4884-4b46-8059-2741bae3c608 tempest-GroupSnapshotsV319Test-1907429282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3.57924123-db11-466c-acb6-53360e3fe4ed {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:46 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3.57924123-db11-466c-acb6-53360e3fe4ed Sep 05 11:40:46 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:46 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:40:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Flow 'volume_create_manager' (6420df65-d14f-4ec0-b902-68d4250821ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:40:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2acb98bf-6fc4-4774-b62e-3be3efbf368d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2acb98bf-6fc4-4774-b62e-3be3efbf368d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-908803278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=773d5bed-f19d-485a-9a1a-33beb8e583cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a43c2d4a4b24479ad9a2bf776e4cd7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:40:46Z,use_quota=True,user_id='df64845cefec4286a145bf5f17d78a64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (612e7754-e45b-454f-b7e2-3a1b058d5515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (612e7754-e45b-454f-b7e2-3a1b058d5515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b020c799-925d-40ec-ba0e-46718b4fb9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:46 devstack cinder-volume[87517]: DEBUG cinder.image.glance [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Creating Keystone auth plugin from conf {{(pid=87517) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 11:40:46 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-91fd8c1d-4884-4b46-8059-2741bae3c608 tempest-GroupSnapshotsV319Test-1907429282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3.57924123-db11-466c-acb6-53360e3fe4ed" returned: 0 in 0.696s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-91fd8c1d-4884-4b46-8059-2741bae3c608 tempest-GroupSnapshotsV319Test-1907429282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:40:46 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[37439e47-83dd-489d-b26a-a930c7cca037]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:40:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-91fd8c1d-4884-4b46-8059-2741bae3c608 tempest-GroupSnapshotsV319Test-1907429282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b020c799-925d-40ec-ba0e-46718b4fb9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '773d5bed-f19d-485a-9a1a-33beb8e583cf', 'volume_name': 'volume-773d5bed-f19d-485a-9a1a-33beb8e583cf', 'volume_size': 1, 'image_id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c73a992b4ff1451ca3178925081bf687', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'created_at': datetime.datetime(2026, 9, 5, 9, 26, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 9, 26, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f04b89-deef-4567-8a94-b4689133ebc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f04b89-deef-4567-8a94-b4689133ebc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (374ee52e-229f-4a03-bb18-2844490f7d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:47 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Volume 773d5bed-f19d-485a-9a1a-33beb8e583cf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-773d5bed-f19d-485a-9a1a-33beb8e583cf', 'volume_size': 1, 'image_id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c73a992b4ff1451ca3178925081bf687', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'created_at': datetime.datetime(2026, 9, 5, 9, 26, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 9, 26, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 05 11:40:47 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Trying to clone 773d5bed-f19d-485a-9a1a-33beb8e583cf from image fff52cc1-bd64-4eb0-8735-62bad8dd7741 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'metadata': {}}]). {{(pid=87517) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 11:40:47 devstack sudo[97779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3 Sep 05 11:40:47 devstack sudo[97779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:47 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_5epe957zdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 11:40:47 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Image download 20.69 MB at 20.69 MB/s Sep 05 11:40:47 devstack sudo[97779]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-91fd8c1d-4884-4b46-8059-2741bae3c608 tempest-GroupSnapshotsV319Test-1907429282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3" returned: 0 in 0.985s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-91fd8c1d-4884-4b46-8059-2741bae3c608 tempest-GroupSnapshotsV319Test-1907429282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3.57924123-db11-466c-acb6-53360e3fe4ed {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:47 devstack sudo[97842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3.57924123-db11-466c-acb6-53360e3fe4ed Sep 05 11:40:47 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:47 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[39022875-1c0b-4e70-8ee4-b8a27eae330f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:40:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_5epe957zdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:48 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_5epe957zdevstack@QuobyteHD Sep 05 11:40:48 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:48 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-91fd8c1d-4884-4b46-8059-2741bae3c608 tempest-GroupSnapshotsV319Test-1907429282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3.57924123-db11-466c-acb6-53360e3fe4ed" returned: 0 in 0.628s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-91fd8c1d-4884-4b46-8059-2741bae3c608 tempest-GroupSnapshotsV319Test-1907429282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3.57924123-db11-466c-acb6-53360e3fe4ed {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:48 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_5epe957zdevstack@QuobyteHD" returned: 0 in 0.589s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:48 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Temporary image fff52cc1-bd64-4eb0-8735-62bad8dd7741 is fetched for user df64845cefec4286a145bf5f17d78a64. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 11:40:48 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3.57924123-db11-466c-acb6-53360e3fe4ed Sep 05 11:40:48 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:48 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[75faf4bb-a4dd-460e-8e30-eb07b18ecaed]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:40:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_5epe957zdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:48 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-91fd8c1d-4884-4b46-8059-2741bae3c608 tempest-GroupSnapshotsV319Test-1907429282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3.57924123-db11-466c-acb6-53360e3fe4ed" returned: 0 in 0.425s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:48 devstack sudo[97876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_5epe957zdevstack@QuobyteHD Sep 05 11:40:48 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-91fd8c1d-4884-4b46-8059-2741bae3c608 tempest-GroupSnapshotsV319Test-1907429282 None] Lock "cinder-quobyte-57924123-db11-466c-acb6-53360e3fe4ed" released by "_delete_snapshot" :: held 2.966s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:40:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-91fd8c1d-4884-4b46-8059-2741bae3c608 tempest-GroupSnapshotsV319Test-1907429282 None] Lock "cinder-quobyte-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3" released by "delete_snapshot" :: held 3.031s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:40:49 devstack cinder-volume[87517]: WARNING cinder.quota [None req-91fd8c1d-4884-4b46-8059-2741bae3c608 tempest-GroupSnapshotsV319Test-1907429282 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1539271226 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1539271226, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:40:49 devstack cinder-volume[87517]: WARNING cinder.quota [None req-91fd8c1d-4884-4b46-8059-2741bae3c608 tempest-GroupSnapshotsV319Test-1907429282 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1539271226 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1539271226, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:40:49 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-a08e0e36-59c9-45f3-aa67-6e723ec48aba req-7ecb594c-4c6a-43b8-88f5-d0198dc25035 tempest-TestShelveInstance-1424890929 None] Terminate volume connection completed successfully. Sep 05 11:40:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-a08e0e36-59c9-45f3-aa67-6e723ec48aba req-7ecb594c-4c6a-43b8-88f5-d0198dc25035 tempest-TestShelveInstance-1424890929 None] Deleting attachment dcfc9792-2759-4d99-b8a6-feadc76533ad. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 11:40:49 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-91fd8c1d-4884-4b46-8059-2741bae3c608 tempest-GroupSnapshotsV319Test-1907429282 None] Created reservations ['0a2f1fa8-4567-4c76-bde5-2b152720450d', 'be69b48f-a8e5-4aeb-9c81-ef9e3bfc04a6', 'a9df405d-d8c0-49f5-872b-d3cb535498ff', '9beb1aff-4764-413e-b2dd-c5f1463e9133'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:40:49 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_5epe957zdevstack@QuobyteHD" returned: 0 in 0.564s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:40:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:40:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-908803278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=773d5bed-f19d-485a-9a1a-33beb8e583cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a43c2d4a4b24479ad9a2bf776e4cd7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:40:46Z,use_quota=True,user_id='df64845cefec4286a145bf5f17d78a64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:40:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Creating volume 773d5bed-f19d-485a-9a1a-33beb8e583cf {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:40:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:40:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:40:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:40:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:40:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:40:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:40:49 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:40:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-773d5bed-f19d-485a-9a1a-33beb8e583cf 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:49 devstack sudo[97886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-773d5bed-f19d-485a-9a1a-33beb8e583cf 1073741824 Sep 05 11:40:49 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-91fd8c1d-4884-4b46-8059-2741bae3c608 tempest-GroupSnapshotsV319Test-1907429282 None] group_snapshot 2c27afc3-73dc-4691-be64-4f614c492a15: deleted successfully Sep 05 11:40:49 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-a08e0e36-59c9-45f3-aa67-6e723ec48aba req-9ff8271d-65df-4e30-b171-16c2872e753c tempest-TestShelveInstance-1424890929 None] Acquiring lock "cinder-e07f2cf7-3339-444a-b467-affe67a8a31d-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:40:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-a08e0e36-59c9-45f3-aa67-6e723ec48aba req-9ff8271d-65df-4e30-b171-16c2872e753c tempest-TestShelveInstance-1424890929 None] Lock "cinder-e07f2cf7-3339-444a-b467-affe67a8a31d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:40:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-a08e0e36-59c9-45f3-aa67-6e723ec48aba req-9ff8271d-65df-4e30-b171-16c2872e753c tempest-TestShelveInstance-1424890929 None] Acquiring lock "cinder-quobyte-e07f2cf7-3339-444a-b467-affe67a8a31d" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:40:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-a08e0e36-59c9-45f3-aa67-6e723ec48aba req-9ff8271d-65df-4e30-b171-16c2872e753c tempest-TestShelveInstance-1424890929 None] Lock "cinder-quobyte-e07f2cf7-3339-444a-b467-affe67a8a31d" acquired by "delete_volume" :: waited 0.039s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:40:49 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6e135b-58ad-49c8-ab29-5dc7209e68e1]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:40:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-a08e0e36-59c9-45f3-aa67-6e723ec48aba req-9ff8271d-65df-4e30-b171-16c2872e753c tempest-TestShelveInstance-1424890929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e07f2cf7-3339-444a-b467-affe67a8a31d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:49 devstack sudo[97888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e07f2cf7-3339-444a-b467-affe67a8a31d Sep 05 11:40:49 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:49 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-773d5bed-f19d-485a-9a1a-33beb8e583cf 1073741824" returned: 0 in 0.684s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1a7f1d49-f5f8-4e54-9a31-8e29cff07522 tempest-GroupSnapshotsV319Test-1907429282 None] Acquiring lock "cinder-quobyte-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:40:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-773d5bed-f19d-485a-9a1a-33beb8e583cf {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1a7f1d49-f5f8-4e54-9a31-8e29cff07522 tempest-GroupSnapshotsV319Test-1907429282 None] Lock "cinder-quobyte-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3" acquired by "delete_volume" :: waited 0.042s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:40:50 devstack sudo[97897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-773d5bed-f19d-485a-9a1a-33beb8e583cf Sep 05 11:40:50 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:50 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0030a34-ed3c-4eeb-a1c2-74cab863480e]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:40:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1a7f1d49-f5f8-4e54-9a31-8e29cff07522 tempest-GroupSnapshotsV319Test-1907429282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:50 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-a08e0e36-59c9-45f3-aa67-6e723ec48aba req-9ff8271d-65df-4e30-b171-16c2872e753c tempest-TestShelveInstance-1424890929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e07f2cf7-3339-444a-b467-affe67a8a31d" returned: 0 in 0.611s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-a08e0e36-59c9-45f3-aa67-6e723ec48aba req-9ff8271d-65df-4e30-b171-16c2872e753c tempest-TestShelveInstance-1424890929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e07f2cf7-3339-444a-b467-affe67a8a31d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:50 devstack sudo[97901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e07f2cf7-3339-444a-b467-affe67a8a31d Sep 05 11:40:50 devstack sudo[97901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:50 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3 Sep 05 11:40:50 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:50 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-773d5bed-f19d-485a-9a1a-33beb8e583cf" returned: 0 in 0.340s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:40:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:40:50 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Attempting download of fff52cc1-bd64-4eb0-8735-62bad8dd7741 ((None, [{'url': 'file:///opt/stack/data/glance/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'metadata': {}}])) to volume 773d5bed-f19d-485a-9a1a-33beb8e583cf. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 11:40:50 devstack sudo[97901]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:50 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a8caeb-c8d0-4fa0-bf8c-48a9333cdf0a]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:40:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741__i15qapd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-a08e0e36-59c9-45f3-aa67-6e723ec48aba req-9ff8271d-65df-4e30-b171-16c2872e753c tempest-TestShelveInstance-1424890929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e07f2cf7-3339-444a-b467-affe67a8a31d" returned: 0 in 0.307s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-a08e0e36-59c9-45f3-aa67-6e723ec48aba req-9ff8271d-65df-4e30-b171-16c2872e753c tempest-TestShelveInstance-1424890929 None] Lock "cinder-quobyte-e07f2cf7-3339-444a-b467-affe67a8a31d" released by "delete_volume" :: held 0.984s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:40:50 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1a7f1d49-f5f8-4e54-9a31-8e29cff07522 tempest-GroupSnapshotsV319Test-1907429282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3" returned: 0 in 0.447s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1a7f1d49-f5f8-4e54-9a31-8e29cff07522 tempest-GroupSnapshotsV319Test-1907429282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:50 devstack cinder-volume[87517]: DEBUG cinder.quota [req-a08e0e36-59c9-45f3-aa67-6e723ec48aba req-9ff8271d-65df-4e30-b171-16c2872e753c tempest-TestShelveInstance-1424890929 None] Created reservations ['21f6cf5c-fe8e-48f3-ae40-d1eb27ce3017', '4fdc0d62-94f2-4a14-b912-695bfe67c316', 'd4a21c6b-40a8-42e1-93c5-888932335268', '9cf12ff2-1f86-4eb8-882e-84a4e11a321b'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:40:50 devstack sudo[97911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3 Sep 05 11:40:50 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:50 devstack sudo[97908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741__i15qapd Sep 05 11:40:50 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-a08e0e36-59c9-45f3-aa67-6e723ec48aba req-9ff8271d-65df-4e30-b171-16c2872e753c tempest-TestShelveInstance-1424890929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:40:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-a08e0e36-59c9-45f3-aa67-6e723ec48aba req-9ff8271d-65df-4e30-b171-16c2872e753c tempest-TestShelveInstance-1424890929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:40:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-a08e0e36-59c9-45f3-aa67-6e723ec48aba req-9ff8271d-65df-4e30-b171-16c2872e753c tempest-TestShelveInstance-1424890929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:40:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-a08e0e36-59c9-45f3-aa67-6e723ec48aba req-9ff8271d-65df-4e30-b171-16c2872e753c tempest-TestShelveInstance-1424890929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:40:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-a08e0e36-59c9-45f3-aa67-6e723ec48aba req-9ff8271d-65df-4e30-b171-16c2872e753c tempest-TestShelveInstance-1424890929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:40:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-a08e0e36-59c9-45f3-aa67-6e723ec48aba req-9ff8271d-65df-4e30-b171-16c2872e753c tempest-TestShelveInstance-1424890929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:50 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:40:50 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:50 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1a7f1d49-f5f8-4e54-9a31-8e29cff07522 tempest-GroupSnapshotsV319Test-1907429282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3" returned: 0 in 0.315s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:50 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741__i15qapd" returned: 0 in 0.419s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741__i15qapd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1a7f1d49-f5f8-4e54-9a31-8e29cff07522 tempest-GroupSnapshotsV319Test-1907429282 None] Lock "cinder-quobyte-c832ec22-6ac2-46e4-8f6b-1e0fa9a7cea3" released by "delete_volume" :: held 0.861s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:40:51 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-1a7f1d49-f5f8-4e54-9a31-8e29cff07522 tempest-GroupSnapshotsV319Test-1907429282 None] Created reservations ['96bbe79e-26ef-4119-a5c6-cafffaab7680'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:40:51 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741__i15qapd Sep 05 11:40:51 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:51 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-a08e0e36-59c9-45f3-aa67-6e723ec48aba req-9ff8271d-65df-4e30-b171-16c2872e753c tempest-TestShelveInstance-1424890929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.369s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:51 devstack cinder-volume[87517]: DEBUG cinder.manager [req-a08e0e36-59c9-45f3-aa67-6e723ec48aba req-9ff8271d-65df-4e30-b171-16c2872e753c tempest-TestShelveInstance-1424890929 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:40:51 devstack cinder-volume[87517]: WARNING cinder.quota [None req-1a7f1d49-f5f8-4e54-9a31-8e29cff07522 tempest-GroupSnapshotsV319Test-1907429282 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1539271226 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1539271226, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:40:51 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-a08e0e36-59c9-45f3-aa67-6e723ec48aba req-9ff8271d-65df-4e30-b171-16c2872e753c tempest-TestShelveInstance-1424890929 None] Deleted volume successfully. Sep 05 11:40:51 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-a08e0e36-59c9-45f3-aa67-6e723ec48aba req-9ff8271d-65df-4e30-b171-16c2872e753c tempest-TestShelveInstance-1424890929 None] Lock "cinder-e07f2cf7-3339-444a-b467-affe67a8a31d-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:40:51 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-1a7f1d49-f5f8-4e54-9a31-8e29cff07522 tempest-GroupSnapshotsV319Test-1907429282 None] Created reservations ['cbfec6b9-c558-46ca-993b-9a55b777a8ea', 'f7614af9-c533-4525-93a3-8383ae11db6d', '27717dbb-d71d-4302-8a52-35aa354571d4', 'bef5b8be-f54c-4365-90f4-6f580f53dca0'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:40:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1a7f1d49-f5f8-4e54-9a31-8e29cff07522 tempest-GroupSnapshotsV319Test-1907429282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:40:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1a7f1d49-f5f8-4e54-9a31-8e29cff07522 tempest-GroupSnapshotsV319Test-1907429282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:40:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1a7f1d49-f5f8-4e54-9a31-8e29cff07522 tempest-GroupSnapshotsV319Test-1907429282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:40:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1a7f1d49-f5f8-4e54-9a31-8e29cff07522 tempest-GroupSnapshotsV319Test-1907429282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:40:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1a7f1d49-f5f8-4e54-9a31-8e29cff07522 tempest-GroupSnapshotsV319Test-1907429282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:40:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1a7f1d49-f5f8-4e54-9a31-8e29cff07522 tempest-GroupSnapshotsV319Test-1907429282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:51 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:40:51 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:51 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741__i15qapd" returned: 1 in 0.454s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741__i15qapd' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 11:40:51 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e94f33e-f0e7-465f-aa37-a5c338f3ea59]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:40:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_5epe957zdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:51 devstack sudo[97932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_5epe957zdevstack@QuobyteHD Sep 05 11:40:51 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:51 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1a7f1d49-f5f8-4e54-9a31-8e29cff07522 tempest-GroupSnapshotsV319Test-1907429282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.280s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:51 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-1a7f1d49-f5f8-4e54-9a31-8e29cff07522 tempest-GroupSnapshotsV319Test-1907429282 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:40:51 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-1a7f1d49-f5f8-4e54-9a31-8e29cff07522 tempest-GroupSnapshotsV319Test-1907429282 None] Delete group completed successfully. Sep 05 11:40:51 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_5epe957zdevstack@QuobyteHD" returned: 0 in 0.415s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:51 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] fff52cc1-bd64-4eb0-8735-62bad8dd7741 was qcow2, converting to qcow2 {{(pid=87517) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 11:40:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_5epe957zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-773d5bed-f19d-485a-9a1a-33beb8e583cf {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:51 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_5epe957zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-773d5bed-f19d-485a-9a1a-33beb8e583cf Sep 05 11:40:51 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:53 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_5epe957zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-773d5bed-f19d-485a-9a1a-33beb8e583cf" returned: 0 in 2.146s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:53 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_5epe957zdevstack@QuobyteHD, size 112.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-773d5bed-f19d-485a-9a1a-33beb8e583cf {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 11:40:53 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Converted 112.00 MB image at 52.17 MB/s Sep 05 11:40:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-773d5bed-f19d-485a-9a1a-33beb8e583cf 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:53 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-773d5bed-f19d-485a-9a1a-33beb8e583cf 1G Sep 05 11:40:53 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:54 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-773d5bed-f19d-485a-9a1a-33beb8e583cf 1G" returned: 0 in 0.330s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:54 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Downloaded image fff52cc1-bd64-4eb0-8735-62bad8dd7741 ((None, [{'url': 'file:///opt/stack/data/glance/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'metadata': {}}])) to volume 773d5bed-f19d-485a-9a1a-33beb8e583cf successfully. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 11:40:54 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Temporary image fff52cc1-bd64-4eb0-8735-62bad8dd7741 for user df64845cefec4286a145bf5f17d78a64 is deleted. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 11:40:54 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Marking volume 773d5bed-f19d-485a-9a1a-33beb8e583cf as bootable. {{(pid=87517) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 11:40:54 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Copying metadata from image fff52cc1-bd64-4eb0-8735-62bad8dd7741 to 773d5bed-f19d-485a-9a1a-33beb8e583cf. {{(pid=87517) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 11:40:54 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Creating volume glance metadata for volume 773d5bed-f19d-485a-9a1a-33beb8e583cf backed by image fff52cc1-bd64-4eb0-8735-62bad8dd7741 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87517) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 11:40:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (374ee52e-229f-4a03-bb18-2844490f7d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-773d5bed-f19d-485a-9a1a-33beb8e583cf', 'volume_size': 1, 'image_id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c73a992b4ff1451ca3178925081bf687', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'created_at': datetime.datetime(2026, 9, 5, 9, 26, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 9, 26, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3eb9006-1cec-4863-9045-56a4f1c83e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:54 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Volume volume-773d5bed-f19d-485a-9a1a-33beb8e583cf (773d5bed-f19d-485a-9a1a-33beb8e583cf): created successfully Sep 05 11:40:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3eb9006-1cec-4863-9045-56a4f1c83e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Flow 'volume_create_manager' (6420df65-d14f-4ec0-b902-68d4250821ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:40:54 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2de7cd59-5087-4f29-8f45-961a0a78cd87 tempest-VolumesExtendTest-2142228419 None] Created volume successfully. Sep 05 11:40:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-22e36e1c-a49c-4da3-9c4e-f4baf21500aa tempest-VolumesExtendTest-2142228419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:40:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-22e36e1c-a49c-4da3-9c4e-f4baf21500aa tempest-VolumesExtendTest-2142228419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:40:55 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f42db9-0cd2-438b-a774-b1cadd5515aa]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:40:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-22e36e1c-a49c-4da3-9c4e-f4baf21500aa tempest-VolumesExtendTest-2142228419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-773d5bed-f19d-485a-9a1a-33beb8e583cf {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:55 devstack sudo[97953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-773d5bed-f19d-485a-9a1a-33beb8e583cf Sep 05 11:40:55 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:55 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-22e36e1c-a49c-4da3-9c4e-f4baf21500aa tempest-VolumesExtendTest-2142228419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-773d5bed-f19d-485a-9a1a-33beb8e583cf" returned: 0 in 0.460s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-22e36e1c-a49c-4da3-9c4e-f4baf21500aa tempest-VolumesExtendTest-2142228419 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-773d5bed-f19d-485a-9a1a-33beb8e583cf 2G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-22e36e1c-a49c-4da3-9c4e-f4baf21500aa tempest-VolumesExtendTest-2142228419 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-773d5bed-f19d-485a-9a1a-33beb8e583cf 2G" returned: 0 in 0.097s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-22e36e1c-a49c-4da3-9c4e-f4baf21500aa tempest-VolumesExtendTest-2142228419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.593s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:40:55 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-22e36e1c-a49c-4da3-9c4e-f4baf21500aa tempest-VolumesExtendTest-2142228419 None] Extend volume completed successfully. Sep 05 11:40:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6ab7d877-29c5-4bf6-a616-fefd2e017d9d tempest-VolumesExtendTest-2142228419 None] Acquiring lock "cinder-773d5bed-f19d-485a-9a1a-33beb8e583cf-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:40:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6ab7d877-29c5-4bf6-a616-fefd2e017d9d tempest-VolumesExtendTest-2142228419 None] Lock "cinder-773d5bed-f19d-485a-9a1a-33beb8e583cf-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:40:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6ab7d877-29c5-4bf6-a616-fefd2e017d9d tempest-VolumesExtendTest-2142228419 None] Acquiring lock "cinder-quobyte-773d5bed-f19d-485a-9a1a-33beb8e583cf" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:40:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6ab7d877-29c5-4bf6-a616-fefd2e017d9d tempest-VolumesExtendTest-2142228419 None] Lock "cinder-quobyte-773d5bed-f19d-485a-9a1a-33beb8e583cf" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:40:57 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb82fd3f-0fb4-414a-8ea4-f222f7209129]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:40:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6ab7d877-29c5-4bf6-a616-fefd2e017d9d tempest-VolumesExtendTest-2142228419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-773d5bed-f19d-485a-9a1a-33beb8e583cf {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:57 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-773d5bed-f19d-485a-9a1a-33beb8e583cf Sep 05 11:40:57 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:57 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6ab7d877-29c5-4bf6-a616-fefd2e017d9d tempest-VolumesExtendTest-2142228419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-773d5bed-f19d-485a-9a1a-33beb8e583cf" returned: 0 in 0.420s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6ab7d877-29c5-4bf6-a616-fefd2e017d9d tempest-VolumesExtendTest-2142228419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-773d5bed-f19d-485a-9a1a-33beb8e583cf {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:57 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-773d5bed-f19d-485a-9a1a-33beb8e583cf Sep 05 11:40:57 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:57 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6ab7d877-29c5-4bf6-a616-fefd2e017d9d tempest-VolumesExtendTest-2142228419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-773d5bed-f19d-485a-9a1a-33beb8e583cf" returned: 0 in 0.259s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6ab7d877-29c5-4bf6-a616-fefd2e017d9d tempest-VolumesExtendTest-2142228419 None] Lock "cinder-quobyte-773d5bed-f19d-485a-9a1a-33beb8e583cf" released by "delete_volume" :: held 0.744s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:40:57 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-6ab7d877-29c5-4bf6-a616-fefd2e017d9d tempest-VolumesExtendTest-2142228419 None] Created reservations ['57c571fb-97e0-4d6c-821e-1dd919f79e9b', 'b26dbc10-8774-43cd-bfb2-571050d8d2f4', '27c4bb78-da25-456c-b9cb-fc10fae98649', '16ef02d4-8710-419f-a946-4be206375f7b'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:40:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6ab7d877-29c5-4bf6-a616-fefd2e017d9d tempest-VolumesExtendTest-2142228419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:40:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6ab7d877-29c5-4bf6-a616-fefd2e017d9d tempest-VolumesExtendTest-2142228419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:40:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6ab7d877-29c5-4bf6-a616-fefd2e017d9d tempest-VolumesExtendTest-2142228419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:40:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6ab7d877-29c5-4bf6-a616-fefd2e017d9d tempest-VolumesExtendTest-2142228419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:40:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6ab7d877-29c5-4bf6-a616-fefd2e017d9d tempest-VolumesExtendTest-2142228419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:40:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6ab7d877-29c5-4bf6-a616-fefd2e017d9d tempest-VolumesExtendTest-2142228419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:58 devstack sudo[97972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:40:58 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:58 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6ab7d877-29c5-4bf6-a616-fefd2e017d9d tempest-VolumesExtendTest-2142228419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.406s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:58 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-6ab7d877-29c5-4bf6-a616-fefd2e017d9d tempest-VolumesExtendTest-2142228419 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:40:58 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6ab7d877-29c5-4bf6-a616-fefd2e017d9d tempest-VolumesExtendTest-2142228419 None] Deleted volume successfully. Sep 05 11:40:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6ab7d877-29c5-4bf6-a616-fefd2e017d9d tempest-VolumesExtendTest-2142228419 None] Lock "cinder-773d5bed-f19d-485a-9a1a-33beb8e583cf-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:40:58 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:40:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] Flow 'volume_create_manager' (6cfb8eb8-e9da-4b5a-94af-b27ef8e8a7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:40:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a1f302-2391-414e-8dfd-50cb08066768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a1f302-2391-414e-8dfd-50cb08066768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1263427406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b9a67ed-7bad-4d27-8075-5ab97dcada35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a43c2d4a4b24479ad9a2bf776e4cd7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:40:59Z,use_quota=True,user_id='df64845cefec4286a145bf5f17d78a64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd7db725-d294-406e-b8f7-2deca21aa038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd7db725-d294-406e-b8f7-2deca21aa038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c56eea65-bc34-46ed-a75f-bed6648fbca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c56eea65-bc34-46ed-a75f-bed6648fbca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b9a67ed-7bad-4d27-8075-5ab97dcada35', 'volume_name': 'volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e7008ef-ab4d-466b-a432-04855d08783e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e7008ef-ab4d-466b-a432-04855d08783e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b975f98-c263-4f18-9b01-8c1fc6448c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:58 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] Volume 4b9a67ed-7bad-4d27-8075-5ab97dcada35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35', 'volume_size': 1} Sep 05 11:40:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:40:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:40:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1263427406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b9a67ed-7bad-4d27-8075-5ab97dcada35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a43c2d4a4b24479ad9a2bf776e4cd7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:40:59Z,use_quota=True,user_id='df64845cefec4286a145bf5f17d78a64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:40:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] Creating volume 4b9a67ed-7bad-4d27-8075-5ab97dcada35 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:40:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:40:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:40:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:40:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:40:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:40:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:40:58 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:40:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:58 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35 1073741824 Sep 05 11:40:58 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:59 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d62199d1-0845-4804-803d-484f3e0b54b4 tempest-GroupsTest-1595542360 None] Group tempest-Group1-642003460: creating Sep 05 11:40:59 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d62199d1-0845-4804-803d-484f3e0b54b4 tempest-GroupsTest-1595542360 None] Group tempest-Group1-642003460: created successfully Sep 05 11:40:59 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d62199d1-0845-4804-803d-484f3e0b54b4 tempest-GroupsTest-1595542360 None] Create group completed successfully. Sep 05 11:40:59 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35 1073741824" returned: 0 in 0.456s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:40:59 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35 Sep 05 11:40:59 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:40:59 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Sep 05 11:40:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35" returned: 0 in 0.267s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:40:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:40:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:40:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b975f98-c263-4f18-9b01-8c1fc6448c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c00c979e-a4b8-45d8-8c17-9c4b4876c4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:40:59 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] Volume volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35 (4b9a67ed-7bad-4d27-8075-5ab97dcada35): created successfully Sep 05 11:40:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c00c979e-a4b8-45d8-8c17-9c4b4876c4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:40:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] Flow 'volume_create_manager' (6cfb8eb8-e9da-4b5a-94af-b27ef8e8a7b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:40:59 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-447b4bf1-d994-4883-a005-bd233900e295 tempest-VolumesExtendTest-2142228419 None] Created volume successfully. Sep 05 11:41:00 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-cc106826-f532-487a-acb4-d61792c4d28c tempest-GroupsTest-1595542360 None] Group tempest-Group2-648891697: creating Sep 05 11:41:00 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-cc106826-f532-487a-acb4-d61792c4d28c tempest-GroupsTest-1595542360 None] Group tempest-Group2-648891697: created successfully Sep 05 11:41:00 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-cc106826-f532-487a-acb4-d61792c4d28c tempest-GroupsTest-1595542360 None] Create group completed successfully. Sep 05 11:41:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cc10f13c-9eb6-491b-bd5e-8bd6c4f17c6e tempest-VolumesExtendTest-2142228419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:41:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cc10f13c-9eb6-491b-bd5e-8bd6c4f17c6e tempest-VolumesExtendTest-2142228419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:41:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-cc10f13c-9eb6-491b-bd5e-8bd6c4f17c6e tempest-VolumesExtendTest-2142228419 None] Creating offline snapshot b6a28afa-4940-40d5-84f6-9c41cda60675 of volume 4b9a67ed-7bad-4d27-8075-5ab97dcada35 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:41:01 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[608dc234-9bb3-4266-a405-647200adee34]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:41:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cc10f13c-9eb6-491b-bd5e-8bd6c4f17c6e tempest-VolumesExtendTest-2142228419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:01 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35 Sep 05 11:41:01 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:01 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cc10f13c-9eb6-491b-bd5e-8bd6c4f17c6e tempest-VolumesExtendTest-2142228419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35" returned: 0 in 0.389s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cc10f13c-9eb6-491b-bd5e-8bd6c4f17c6e tempest-VolumesExtendTest-2142228419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35.b6a28afa-4940-40d5-84f6-9c41cda60675 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:01 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35.b6a28afa-4940-40d5-84f6-9c41cda60675 1G Sep 05 11:41:01 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:02 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cc10f13c-9eb6-491b-bd5e-8bd6c4f17c6e tempest-VolumesExtendTest-2142228419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35.b6a28afa-4940-40d5-84f6-9c41cda60675 1G" returned: 0 in 0.503s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cc10f13c-9eb6-491b-bd5e-8bd6c4f17c6e tempest-VolumesExtendTest-2142228419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35.b6a28afa-4940-40d5-84f6-9c41cda60675 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:02 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35.b6a28afa-4940-40d5-84f6-9c41cda60675 Sep 05 11:41:02 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:02 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:41:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] Flow 'volume_create_manager' (80d9ab81-6d38-4d12-9c32-2394fcee90fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:41:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20ea7d77-a434-48f5-baaf-54a1cb917209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20ea7d77-a434-48f5-baaf-54a1cb917209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-47659130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=71e6358f-b89a-4735-91d2-4bcb5619293e,host='devstack@QuobyteHD#QuobyteHD',id=e6347072-bdb3-43d1-abc1-ee88eb2cccb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a67074bfd7b4bdbb574c1e7f373deb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:41:02Z,use_quota=True,user_id='e3d4161ac74a4827b3e6767463faf4d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b863ddc-b67c-407f-87f0-13e89e115655),volume_type_id=0b863ddc-b67c-407f-87f0-13e89e115655)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c22d1007-a0f5-432d-9465-f760c25cfe95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c22d1007-a0f5-432d-9465-f760c25cfe95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b8f11a-b1a5-49b1-9b05-56bee5034a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b8f11a-b1a5-49b1-9b05-56bee5034a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6347072-bdb3-43d1-abc1-ee88eb2cccb2', 'volume_name': 'volume-e6347072-bdb3-43d1-abc1-ee88eb2cccb2', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e36f8b90-06db-401d-bd1c-eed7404ed518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e36f8b90-06db-401d-bd1c-eed7404ed518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42db9aaa-2d88-4038-9a67-4b18b3b17694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:02 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] Volume e6347072-bdb3-43d1-abc1-ee88eb2cccb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6347072-bdb3-43d1-abc1-ee88eb2cccb2', 'volume_size': 1} Sep 05 11:41:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:41:02 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cc10f13c-9eb6-491b-bd5e-8bd6c4f17c6e tempest-VolumesExtendTest-2142228419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35.b6a28afa-4940-40d5-84f6-9c41cda60675" returned: 0 in 0.386s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:02 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-cc10f13c-9eb6-491b-bd5e-8bd6c4f17c6e tempest-VolumesExtendTest-2142228419 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35.b6a28afa-4940-40d5-84f6-9c41cda60675 is being set with open permissions: ugo+rw Sep 05 11:41:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cc10f13c-9eb6-491b-bd5e-8bd6c4f17c6e tempest-VolumesExtendTest-2142228419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35.b6a28afa-4940-40d5-84f6-9c41cda60675 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:02 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35.b6a28afa-4940-40d5-84f6-9c41cda60675 Sep 05 11:41:02 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:02 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cc10f13c-9eb6-491b-bd5e-8bd6c4f17c6e tempest-VolumesExtendTest-2142228419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35.b6a28afa-4940-40d5-84f6-9c41cda60675" returned: 0 in 0.276s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cc10f13c-9eb6-491b-bd5e-8bd6c4f17c6e tempest-VolumesExtendTest-2142228419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:02 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35.info Sep 05 11:41:02 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:03 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cc10f13c-9eb6-491b-bd5e-8bd6c4f17c6e tempest-VolumesExtendTest-2142228419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35.info" returned: 0 in 0.247s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:03 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-cc10f13c-9eb6-491b-bd5e-8bd6c4f17c6e tempest-VolumesExtendTest-2142228419 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35.info is being set with open permissions: ugo+rw Sep 05 11:41:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cc10f13c-9eb6-491b-bd5e-8bd6c4f17c6e tempest-VolumesExtendTest-2142228419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:03 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35.info Sep 05 11:41:03 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:03 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cc10f13c-9eb6-491b-bd5e-8bd6c4f17c6e tempest-VolumesExtendTest-2142228419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35.info" returned: 0 in 0.259s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cc10f13c-9eb6-491b-bd5e-8bd6c4f17c6e tempest-VolumesExtendTest-2142228419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.173s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:41:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.982s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:41:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=71e6358f-b89a-4735-91d2-4bcb5619293e,created_at=2026-09-05T09:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-47659130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=71e6358f-b89a-4735-91d2-4bcb5619293e,host='devstack@QuobyteHD#QuobyteHD',id=e6347072-bdb3-43d1-abc1-ee88eb2cccb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a67074bfd7b4bdbb574c1e7f373deb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:41:02Z,use_quota=True,user_id='e3d4161ac74a4827b3e6767463faf4d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b863ddc-b67c-407f-87f0-13e89e115655),volume_type_id=0b863ddc-b67c-407f-87f0-13e89e115655)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:41:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] Creating volume e6347072-bdb3-43d1-abc1-ee88eb2cccb2 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:41:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:41:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:41:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:41:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:41:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:41:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:41:03 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:41:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e6347072-bdb3-43d1-abc1-ee88eb2cccb2 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:03 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e6347072-bdb3-43d1-abc1-ee88eb2cccb2 1073741824 Sep 05 11:41:03 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:03 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-cc10f13c-9eb6-491b-bd5e-8bd6c4f17c6e tempest-VolumesExtendTest-2142228419 None] Create snapshot completed successfully Sep 05 11:41:03 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e6347072-bdb3-43d1-abc1-ee88eb2cccb2 1073741824" returned: 0 in 0.467s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e6347072-bdb3-43d1-abc1-ee88eb2cccb2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:03 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e6347072-bdb3-43d1-abc1-ee88eb2cccb2 Sep 05 11:41:03 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:04 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e6347072-bdb3-43d1-abc1-ee88eb2cccb2" returned: 0 in 0.258s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:41:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:41:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42db9aaa-2d88-4038-9a67-4b18b3b17694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6347072-bdb3-43d1-abc1-ee88eb2cccb2', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea01924-8dd5-442d-b17a-b65faf8bba3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:04 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] Volume volume-e6347072-bdb3-43d1-abc1-ee88eb2cccb2 (e6347072-bdb3-43d1-abc1-ee88eb2cccb2): created successfully Sep 05 11:41:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea01924-8dd5-442d-b17a-b65faf8bba3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] Flow 'volume_create_manager' (80d9ab81-6d38-4d12-9c32-2394fcee90fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:41:04 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-93e0003c-3083-414c-8c24-24cf17083807 tempest-GroupsTest-1595542360 None] Created volume successfully. Sep 05 11:41:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5291e98c-b884-4a9a-bcb7-4c9e54aecc9a tempest-VolumesExtendTest-2142228419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:41:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5291e98c-b884-4a9a-bcb7-4c9e54aecc9a tempest-VolumesExtendTest-2142228419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:41:04 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7deb25d5-be9b-4e54-b5e1-6791205d5dd1]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:41:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5291e98c-b884-4a9a-bcb7-4c9e54aecc9a tempest-VolumesExtendTest-2142228419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:04 devstack sudo[98019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35 Sep 05 11:41:04 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:04 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5291e98c-b884-4a9a-bcb7-4c9e54aecc9a tempest-VolumesExtendTest-2142228419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35" returned: 0 in 0.408s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5291e98c-b884-4a9a-bcb7-4c9e54aecc9a tempest-VolumesExtendTest-2142228419 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35.b6a28afa-4940-40d5-84f6-9c41cda60675 2G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5291e98c-b884-4a9a-bcb7-4c9e54aecc9a tempest-VolumesExtendTest-2142228419 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35.b6a28afa-4940-40d5-84f6-9c41cda60675 2G" returned: 0 in 0.176s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5291e98c-b884-4a9a-bcb7-4c9e54aecc9a tempest-VolumesExtendTest-2142228419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.656s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:41:05 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-5291e98c-b884-4a9a-bcb7-4c9e54aecc9a tempest-VolumesExtendTest-2142228419 None] Extend volume completed successfully. Sep 05 11:41:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e2b44d88-808c-4efd-8be2-c726b83caba6 tempest-GroupsTest-1595542360 None] Acquiring lock "cinder-quobyte-e6347072-bdb3-43d1-abc1-ee88eb2cccb2" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:41:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e2b44d88-808c-4efd-8be2-c726b83caba6 tempest-GroupsTest-1595542360 None] Lock "cinder-quobyte-e6347072-bdb3-43d1-abc1-ee88eb2cccb2" acquired by "delete_volume" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:41:05 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55fd2b0-55b8-4f52-a21b-db7e0042987a]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:41:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e2b44d88-808c-4efd-8be2-c726b83caba6 tempest-GroupsTest-1595542360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e6347072-bdb3-43d1-abc1-ee88eb2cccb2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:05 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e6347072-bdb3-43d1-abc1-ee88eb2cccb2 Sep 05 11:41:05 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c4093542-6374-41db-8017-5797b9a19fda tempest-VolumesExtendTest-2142228419 None] Acquiring lock "cinder-b6a28afa-4940-40d5-84f6-9c41cda60675-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:41:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c4093542-6374-41db-8017-5797b9a19fda tempest-VolumesExtendTest-2142228419 None] Lock "cinder-b6a28afa-4940-40d5-84f6-9c41cda60675-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:41:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c4093542-6374-41db-8017-5797b9a19fda tempest-VolumesExtendTest-2142228419 None] Acquiring lock "cinder-quobyte-4b9a67ed-7bad-4d27-8075-5ab97dcada35" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:41:05 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e2b44d88-808c-4efd-8be2-c726b83caba6 tempest-GroupsTest-1595542360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e6347072-bdb3-43d1-abc1-ee88eb2cccb2" returned: 0 in 0.396s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e2b44d88-808c-4efd-8be2-c726b83caba6 tempest-GroupsTest-1595542360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e6347072-bdb3-43d1-abc1-ee88eb2cccb2 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c4093542-6374-41db-8017-5797b9a19fda tempest-VolumesExtendTest-2142228419 None] Lock "cinder-quobyte-4b9a67ed-7bad-4d27-8075-5ab97dcada35" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:41:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c4093542-6374-41db-8017-5797b9a19fda tempest-VolumesExtendTest-2142228419 None] Acquiring lock "cinder-quobyte-b6a28afa-4940-40d5-84f6-9c41cda60675" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:41:05 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e6347072-bdb3-43d1-abc1-ee88eb2cccb2 Sep 05 11:41:05 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c4093542-6374-41db-8017-5797b9a19fda tempest-VolumesExtendTest-2142228419 None] Lock "cinder-quobyte-b6a28afa-4940-40d5-84f6-9c41cda60675" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:41:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-c4093542-6374-41db-8017-5797b9a19fda tempest-VolumesExtendTest-2142228419 None] Deleting offline snapshot b6a28afa-4940-40d5-84f6-9c41cda60675 of volume 4b9a67ed-7bad-4d27-8075-5ab97dcada35 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:41:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-c4093542-6374-41db-8017-5797b9a19fda tempest-VolumesExtendTest-2142228419 None] snapshot_file for this snap is: volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35.b6a28afa-4940-40d5-84f6-9c41cda60675 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:41:05 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[113cb1e4-c938-47d0-8336-90250b803359]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:41:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c4093542-6374-41db-8017-5797b9a19fda tempest-VolumesExtendTest-2142228419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35.b6a28afa-4940-40d5-84f6-9c41cda60675 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:05 devstack sudo[98035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35.b6a28afa-4940-40d5-84f6-9c41cda60675 Sep 05 11:41:05 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:05 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e2b44d88-808c-4efd-8be2-c726b83caba6 tempest-GroupsTest-1595542360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e6347072-bdb3-43d1-abc1-ee88eb2cccb2" returned: 0 in 0.252s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e2b44d88-808c-4efd-8be2-c726b83caba6 tempest-GroupsTest-1595542360 None] Lock "cinder-quobyte-e6347072-bdb3-43d1-abc1-ee88eb2cccb2" released by "delete_volume" :: held 0.696s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:41:06 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-e2b44d88-808c-4efd-8be2-c726b83caba6 tempest-GroupsTest-1595542360 None] Created reservations ['753a8e79-55f6-4a07-9b62-40d8edd5037d'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:41:06 devstack cinder-volume[87517]: WARNING cinder.quota [None req-e2b44d88-808c-4efd-8be2-c726b83caba6 tempest-GroupsTest-1595542360 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-245149550 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-245149550, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:41:06 devstack cinder-volume[87517]: WARNING cinder.quota [None req-e2b44d88-808c-4efd-8be2-c726b83caba6 tempest-GroupsTest-1595542360 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-245149550 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-245149550, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:41:06 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-e2b44d88-808c-4efd-8be2-c726b83caba6 tempest-GroupsTest-1595542360 None] Created reservations ['2afb7964-66a6-4702-bcfb-6500bbbf4837', '362f834a-19eb-4225-b550-a8bd3e77518b', 'dc8faf80-3eb1-4228-a9b9-abc1fd09e8d8', '2bd03b22-441b-46e0-90de-8964d7a8a681'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:41:06 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c4093542-6374-41db-8017-5797b9a19fda tempest-VolumesExtendTest-2142228419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35.b6a28afa-4940-40d5-84f6-9c41cda60675" returned: 0 in 0.464s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-c4093542-6374-41db-8017-5797b9a19fda tempest-VolumesExtendTest-2142228419 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:41:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e2b44d88-808c-4efd-8be2-c726b83caba6 tempest-GroupsTest-1595542360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:41:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e2b44d88-808c-4efd-8be2-c726b83caba6 tempest-GroupsTest-1595542360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:41:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e2b44d88-808c-4efd-8be2-c726b83caba6 tempest-GroupsTest-1595542360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:41:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e2b44d88-808c-4efd-8be2-c726b83caba6 tempest-GroupsTest-1595542360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:41:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e2b44d88-808c-4efd-8be2-c726b83caba6 tempest-GroupsTest-1595542360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:41:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e2b44d88-808c-4efd-8be2-c726b83caba6 tempest-GroupsTest-1595542360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:06 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7d97a4-ec46-4fea-9eca-52cd9a66ecde]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:41:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c4093542-6374-41db-8017-5797b9a19fda tempest-VolumesExtendTest-2142228419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:06 devstack sudo[98041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:41:06 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:06 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35 Sep 05 11:41:06 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:06 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e2b44d88-808c-4efd-8be2-c726b83caba6 tempest-GroupsTest-1595542360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.309s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:06 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-e2b44d88-808c-4efd-8be2-c726b83caba6 tempest-GroupsTest-1595542360 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:41:06 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e2b44d88-808c-4efd-8be2-c726b83caba6 tempest-GroupsTest-1595542360 None] Delete group completed successfully. Sep 05 11:41:06 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-52ea4adb-6037-4752-b62e-602606976010 tempest-GroupsTest-1595542360 None] Created reservations ['d9876631-acfc-43e1-9cce-1b5c11117248'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:41:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-52ea4adb-6037-4752-b62e-602606976010 tempest-GroupsTest-1595542360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:41:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-52ea4adb-6037-4752-b62e-602606976010 tempest-GroupsTest-1595542360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:41:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-52ea4adb-6037-4752-b62e-602606976010 tempest-GroupsTest-1595542360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:41:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-52ea4adb-6037-4752-b62e-602606976010 tempest-GroupsTest-1595542360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:41:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-52ea4adb-6037-4752-b62e-602606976010 tempest-GroupsTest-1595542360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:41:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-52ea4adb-6037-4752-b62e-602606976010 tempest-GroupsTest-1595542360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:06 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:41:06 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:06 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c4093542-6374-41db-8017-5797b9a19fda tempest-VolumesExtendTest-2142228419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35" returned: 0 in 0.461s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c4093542-6374-41db-8017-5797b9a19fda tempest-VolumesExtendTest-2142228419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35.b6a28afa-4940-40d5-84f6-9c41cda60675 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:06 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35.b6a28afa-4940-40d5-84f6-9c41cda60675 Sep 05 11:41:06 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:06 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-52ea4adb-6037-4752-b62e-602606976010 tempest-GroupsTest-1595542360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.259s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:06 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-52ea4adb-6037-4752-b62e-602606976010 tempest-GroupsTest-1595542360 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:41:06 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-52ea4adb-6037-4752-b62e-602606976010 tempest-GroupsTest-1595542360 None] Delete group completed successfully. Sep 05 11:41:07 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c4093542-6374-41db-8017-5797b9a19fda tempest-VolumesExtendTest-2142228419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35.b6a28afa-4940-40d5-84f6-9c41cda60675" returned: 0 in 0.373s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c4093542-6374-41db-8017-5797b9a19fda tempest-VolumesExtendTest-2142228419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35.b6a28afa-4940-40d5-84f6-9c41cda60675 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:07 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35.b6a28afa-4940-40d5-84f6-9c41cda60675 Sep 05 11:41:07 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:07 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c4093542-6374-41db-8017-5797b9a19fda tempest-VolumesExtendTest-2142228419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35.b6a28afa-4940-40d5-84f6-9c41cda60675" returned: 0 in 0.292s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c4093542-6374-41db-8017-5797b9a19fda tempest-VolumesExtendTest-2142228419 None] Lock "cinder-quobyte-b6a28afa-4940-40d5-84f6-9c41cda60675" released by "_delete_snapshot" :: held 1.750s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:41:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c4093542-6374-41db-8017-5797b9a19fda tempest-VolumesExtendTest-2142228419 None] Lock "cinder-quobyte-4b9a67ed-7bad-4d27-8075-5ab97dcada35" released by "delete_snapshot" :: held 1.778s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:41:07 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-c4093542-6374-41db-8017-5797b9a19fda tempest-VolumesExtendTest-2142228419 None] Created reservations ['d68ca563-6735-4230-9037-f57d14dd658d', '9587726e-d505-4e62-a090-cf77d5b21ef1', '0996932d-6fcd-4fd2-b44d-d2a57a140e1d', '504a97ac-d37c-4c64-a022-0737e8d3883d'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:41:07 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c4093542-6374-41db-8017-5797b9a19fda tempest-VolumesExtendTest-2142228419 None] Delete snapshot completed successfully. Sep 05 11:41:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c4093542-6374-41db-8017-5797b9a19fda tempest-VolumesExtendTest-2142228419 None] Lock "cinder-b6a28afa-4940-40d5-84f6-9c41cda60675-delete_snapshot" released by "delete_snapshot" :: held 1.943s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:41:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4c853d29-5f11-4629-a7cc-3659dbab6d30 tempest-VolumesExtendTest-2142228419 None] Acquiring lock "cinder-4b9a67ed-7bad-4d27-8075-5ab97dcada35-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:41:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4c853d29-5f11-4629-a7cc-3659dbab6d30 tempest-VolumesExtendTest-2142228419 None] Lock "cinder-4b9a67ed-7bad-4d27-8075-5ab97dcada35-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:41:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4c853d29-5f11-4629-a7cc-3659dbab6d30 tempest-VolumesExtendTest-2142228419 None] Acquiring lock "cinder-quobyte-4b9a67ed-7bad-4d27-8075-5ab97dcada35" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:41:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4c853d29-5f11-4629-a7cc-3659dbab6d30 tempest-VolumesExtendTest-2142228419 None] Lock "cinder-quobyte-4b9a67ed-7bad-4d27-8075-5ab97dcada35" acquired by "delete_volume" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:41:08 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcf520e-9793-49aa-81e7-6128dd63dcb1]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:41:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4c853d29-5f11-4629-a7cc-3659dbab6d30 tempest-VolumesExtendTest-2142228419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:08 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35 Sep 05 11:41:08 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:08 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-0b3c9836-9dd6-422d-9782-e57522953f49 tempest-GroupsTest-1595542360 None] Group tempest-GroupsTest-Group-538666891: creating Sep 05 11:41:08 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-0b3c9836-9dd6-422d-9782-e57522953f49 tempest-GroupsTest-1595542360 None] Group tempest-GroupsTest-Group-538666891: created successfully Sep 05 11:41:08 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-0b3c9836-9dd6-422d-9782-e57522953f49 tempest-GroupsTest-1595542360 None] Create group completed successfully. Sep 05 11:41:08 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4c853d29-5f11-4629-a7cc-3659dbab6d30 tempest-VolumesExtendTest-2142228419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35" returned: 0 in 0.421s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4c853d29-5f11-4629-a7cc-3659dbab6d30 tempest-VolumesExtendTest-2142228419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:08 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35 Sep 05 11:41:08 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:08 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4c853d29-5f11-4629-a7cc-3659dbab6d30 tempest-VolumesExtendTest-2142228419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4b9a67ed-7bad-4d27-8075-5ab97dcada35" returned: 0 in 0.326s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4c853d29-5f11-4629-a7cc-3659dbab6d30 tempest-VolumesExtendTest-2142228419 None] Lock "cinder-quobyte-4b9a67ed-7bad-4d27-8075-5ab97dcada35" released by "delete_volume" :: held 0.821s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:41:08 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-4c853d29-5f11-4629-a7cc-3659dbab6d30 tempest-VolumesExtendTest-2142228419 None] Created reservations ['889064f9-d299-4fde-8e31-6e779423cbcf', '8bb8cf1a-35bb-40d9-a700-43b898332f05', '4775cce1-1cac-42b6-9c3a-ffdd0c42ad5f', 'b3ca5073-002e-4671-b31d-0b898af93a52'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:41:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4c853d29-5f11-4629-a7cc-3659dbab6d30 tempest-VolumesExtendTest-2142228419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:41:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4c853d29-5f11-4629-a7cc-3659dbab6d30 tempest-VolumesExtendTest-2142228419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:41:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4c853d29-5f11-4629-a7cc-3659dbab6d30 tempest-VolumesExtendTest-2142228419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:41:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4c853d29-5f11-4629-a7cc-3659dbab6d30 tempest-VolumesExtendTest-2142228419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:41:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4c853d29-5f11-4629-a7cc-3659dbab6d30 tempest-VolumesExtendTest-2142228419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:41:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4c853d29-5f11-4629-a7cc-3659dbab6d30 tempest-VolumesExtendTest-2142228419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:09 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:41:09 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:09 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4c853d29-5f11-4629-a7cc-3659dbab6d30 tempest-VolumesExtendTest-2142228419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.280s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:09 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-4c853d29-5f11-4629-a7cc-3659dbab6d30 tempest-VolumesExtendTest-2142228419 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:41:09 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-4c853d29-5f11-4629-a7cc-3659dbab6d30 tempest-VolumesExtendTest-2142228419 None] Deleted volume successfully. Sep 05 11:41:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4c853d29-5f11-4629-a7cc-3659dbab6d30 tempest-VolumesExtendTest-2142228419 None] Lock "cinder-4b9a67ed-7bad-4d27-8075-5ab97dcada35-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:41:10 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:41:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] Flow 'volume_create_manager' (a6c41b9d-2f58-4cd7-9ee6-54c31424bbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:41:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1232eaad-cd28-460e-8b31-b29f8a1c0672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1232eaad-cd28-460e-8b31-b29f8a1c0672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1285836894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fddd29f1-700d-41df-9a8d-aa0dda02e3e6,host='devstack@QuobyteHD#QuobyteHD',id=ed94d031-a6c5-4eb7-b019-7b313e610138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a67074bfd7b4bdbb574c1e7f373deb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:41:10Z,use_quota=True,user_id='e3d4161ac74a4827b3e6767463faf4d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eba7071d-0704-49c9-a94b-3201e81fe086),volume_type_id=eba7071d-0704-49c9-a94b-3201e81fe086)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b6c044a-71e6-4fb6-aa44-77a46f2e4a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b6c044a-71e6-4fb6-aa44-77a46f2e4a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b472fcf4-5ff6-43c3-837f-0f6f1b189ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b472fcf4-5ff6-43c3-837f-0f6f1b189ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed94d031-a6c5-4eb7-b019-7b313e610138', 'volume_name': 'volume-ed94d031-a6c5-4eb7-b019-7b313e610138', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1030b282-3768-45d4-9e07-d401d586bfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1030b282-3768-45d4-9e07-d401d586bfed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77eb1a1f-3888-4774-866f-a27f911df0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:10 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] Volume ed94d031-a6c5-4eb7-b019-7b313e610138: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed94d031-a6c5-4eb7-b019-7b313e610138', 'volume_size': 1} Sep 05 11:41:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:41:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:41:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fddd29f1-700d-41df-9a8d-aa0dda02e3e6,created_at=2026-09-05T09:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1285836894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fddd29f1-700d-41df-9a8d-aa0dda02e3e6,host='devstack@QuobyteHD#QuobyteHD',id=ed94d031-a6c5-4eb7-b019-7b313e610138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a67074bfd7b4bdbb574c1e7f373deb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:41:10Z,use_quota=True,user_id='e3d4161ac74a4827b3e6767463faf4d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eba7071d-0704-49c9-a94b-3201e81fe086),volume_type_id=eba7071d-0704-49c9-a94b-3201e81fe086)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:41:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] Creating volume ed94d031-a6c5-4eb7-b019-7b313e610138 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:41:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:41:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:41:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:41:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:41:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:41:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:41:10 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:41:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ed94d031-a6c5-4eb7-b019-7b313e610138 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:10 devstack sudo[98073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ed94d031-a6c5-4eb7-b019-7b313e610138 1073741824 Sep 05 11:41:10 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:10 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ed94d031-a6c5-4eb7-b019-7b313e610138 1073741824" returned: 0 in 0.560s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ed94d031-a6c5-4eb7-b019-7b313e610138 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:10 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ed94d031-a6c5-4eb7-b019-7b313e610138 Sep 05 11:41:10 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:11 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ed94d031-a6c5-4eb7-b019-7b313e610138" returned: 0 in 0.280s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:41:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:41:11 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=182,cinder:SELECT=168,cinder:INSERT=40,cinder:DELETE=9 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:41:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77eb1a1f-3888-4774-866f-a27f911df0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed94d031-a6c5-4eb7-b019-7b313e610138', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb8eaab3-16aa-4b21-8788-b4c8975fb975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:11 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] Volume volume-ed94d031-a6c5-4eb7-b019-7b313e610138 (ed94d031-a6c5-4eb7-b019-7b313e610138): created successfully Sep 05 11:41:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb8eaab3-16aa-4b21-8788-b4c8975fb975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] Flow 'volume_create_manager' (a6c41b9d-2f58-4cd7-9ee6-54c31424bbf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:41:11 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e9094911-7c06-48d9-90ab-9918dd8915b3 tempest-GroupsTest-1595542360 None] Created volume successfully. Sep 05 11:41:12 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:41:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] Flow 'volume_create_manager' (65350419-1a47-4ff4-b35d-f20e055901a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:41:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570d245f-af61-49d1-a3b4-d3287611578a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570d245f-af61-49d1-a3b4-d3287611578a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-893367991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fddd29f1-700d-41df-9a8d-aa0dda02e3e6,host='devstack@QuobyteHD#QuobyteHD',id=96ec9027-0ef1-4fbd-9677-67e0eb30bea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a67074bfd7b4bdbb574c1e7f373deb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:41:12Z,use_quota=True,user_id='e3d4161ac74a4827b3e6767463faf4d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eba7071d-0704-49c9-a94b-3201e81fe086),volume_type_id=eba7071d-0704-49c9-a94b-3201e81fe086)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3edafcb8-949b-41b1-8816-1100f816ef21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3edafcb8-949b-41b1-8816-1100f816ef21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3d1c848-e740-4877-a45d-84c4233e6c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3d1c848-e740-4877-a45d-84c4233e6c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96ec9027-0ef1-4fbd-9677-67e0eb30bea0', 'volume_name': 'volume-96ec9027-0ef1-4fbd-9677-67e0eb30bea0', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (295de72a-9537-47f2-99f3-2507f7bac267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (295de72a-9537-47f2-99f3-2507f7bac267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b6df58f-76dc-4552-b23f-97e1b4b53169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:12 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] Volume 96ec9027-0ef1-4fbd-9677-67e0eb30bea0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96ec9027-0ef1-4fbd-9677-67e0eb30bea0', 'volume_size': 1} Sep 05 11:41:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:41:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:41:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fddd29f1-700d-41df-9a8d-aa0dda02e3e6,created_at=2026-09-05T09:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-893367991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fddd29f1-700d-41df-9a8d-aa0dda02e3e6,host='devstack@QuobyteHD#QuobyteHD',id=96ec9027-0ef1-4fbd-9677-67e0eb30bea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a67074bfd7b4bdbb574c1e7f373deb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:41:12Z,use_quota=True,user_id='e3d4161ac74a4827b3e6767463faf4d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eba7071d-0704-49c9-a94b-3201e81fe086),volume_type_id=eba7071d-0704-49c9-a94b-3201e81fe086)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:41:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] Creating volume 96ec9027-0ef1-4fbd-9677-67e0eb30bea0 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:41:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:41:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:41:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:41:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:41:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:41:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:41:12 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:41:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-96ec9027-0ef1-4fbd-9677-67e0eb30bea0 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:12 devstack sudo[98083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-96ec9027-0ef1-4fbd-9677-67e0eb30bea0 1073741824 Sep 05 11:41:12 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:12 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-96ec9027-0ef1-4fbd-9677-67e0eb30bea0 1073741824" returned: 0 in 0.610s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-96ec9027-0ef1-4fbd-9677-67e0eb30bea0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:12 devstack sudo[98089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-96ec9027-0ef1-4fbd-9677-67e0eb30bea0 Sep 05 11:41:12 devstack sudo[98089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:13 devstack sudo[98089]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-96ec9027-0ef1-4fbd-9677-67e0eb30bea0" returned: 0 in 0.398s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:41:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:41:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b6df58f-76dc-4552-b23f-97e1b4b53169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96ec9027-0ef1-4fbd-9677-67e0eb30bea0', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5902d749-e1d9-4772-b568-1318f6c156f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:13 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] Volume volume-96ec9027-0ef1-4fbd-9677-67e0eb30bea0 (96ec9027-0ef1-4fbd-9677-67e0eb30bea0): created successfully Sep 05 11:41:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5902d749-e1d9-4772-b568-1318f6c156f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] Flow 'volume_create_manager' (65350419-1a47-4ff4-b35d-f20e055901a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:41:13 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-bc456f38-8792-4255-a610-e54ce2f152d5 tempest-GroupsTest-1595542360 None] Created volume successfully. Sep 05 11:41:14 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=166,cinder:INSERT=57,cinder:UPDATE=183,cinder:DELETE=7 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:41:14 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-4ae41dab-1999-49db-a7f1-4953005e3363 tempest-GroupsTest-1595542360 None] Update group completed successfully. Sep 05 11:41:15 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:41:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] Flow 'volume_create_manager' (b61c7263-3655-4a6d-9ad9-8ae62f727ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:41:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477231e8-5ae9-4594-ba28-7276d636cee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477231e8-5ae9-4594-ba28-7276d636cee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-896518283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1386441e-e9c8-4a32-af7f-5ef7204cf29b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c1fe7e365b1d48b2b9580f4796bbea42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:41:15Z,use_quota=True,user_id='d467b9677fb64570a0d79e0680ac33d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd95253-3dfb-4928-8655-6be5b66b8e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd95253-3dfb-4928-8655-6be5b66b8e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (503e262c-9a87-4ba7-85dc-4b66bfd4bb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (503e262c-9a87-4ba7-85dc-4b66bfd4bb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1386441e-e9c8-4a32-af7f-5ef7204cf29b', 'volume_name': 'volume-1386441e-e9c8-4a32-af7f-5ef7204cf29b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10954b3f-0972-469b-9611-36a0e2c95dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10954b3f-0972-469b-9611-36a0e2c95dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (561622cd-975b-4011-84a2-863ee024114c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:15 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] Volume 1386441e-e9c8-4a32-af7f-5ef7204cf29b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1386441e-e9c8-4a32-af7f-5ef7204cf29b', 'volume_size': 1} Sep 05 11:41:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:41:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:41:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-896518283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1386441e-e9c8-4a32-af7f-5ef7204cf29b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c1fe7e365b1d48b2b9580f4796bbea42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:41:15Z,use_quota=True,user_id='d467b9677fb64570a0d79e0680ac33d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:41:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] Creating volume 1386441e-e9c8-4a32-af7f-5ef7204cf29b {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:41:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:41:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:41:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:41:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:41:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:41:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:41:15 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:41:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1386441e-e9c8-4a32-af7f-5ef7204cf29b 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:15 devstack sudo[98092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1386441e-e9c8-4a32-af7f-5ef7204cf29b 1073741824 Sep 05 11:41:15 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:15 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1386441e-e9c8-4a32-af7f-5ef7204cf29b 1073741824" returned: 0 in 0.503s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1386441e-e9c8-4a32-af7f-5ef7204cf29b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:15 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1386441e-e9c8-4a32-af7f-5ef7204cf29b Sep 05 11:41:15 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:16 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ed495011-8eb2-42b2-99d4-501c2619fa46 tempest-GroupsTest-1595542360 None] Update group completed successfully. Sep 05 11:41:16 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1386441e-e9c8-4a32-af7f-5ef7204cf29b" returned: 0 in 0.280s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:41:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:41:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (561622cd-975b-4011-84a2-863ee024114c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1386441e-e9c8-4a32-af7f-5ef7204cf29b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e98439f-4656-4ba0-b13f-0f7fd24fd3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:16 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] Volume volume-1386441e-e9c8-4a32-af7f-5ef7204cf29b (1386441e-e9c8-4a32-af7f-5ef7204cf29b): created successfully Sep 05 11:41:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e98439f-4656-4ba0-b13f-0f7fd24fd3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] Flow 'volume_create_manager' (b61c7263-3655-4a6d-9ad9-8ae62f727ac8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:41:16 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-59095bbb-2102-4ccc-89fc-5ae43e0025c7 tempest-VolumesGetTest-997413188 None] Created volume successfully. Sep 05 11:41:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9f7c2915-c265-4863-bc48-40c8220211d7 tempest-GroupsTest-1595542360 None] Acquiring lock "cinder-quobyte-96ec9027-0ef1-4fbd-9677-67e0eb30bea0" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:41:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9f7c2915-c265-4863-bc48-40c8220211d7 tempest-GroupsTest-1595542360 None] Lock "cinder-quobyte-96ec9027-0ef1-4fbd-9677-67e0eb30bea0" acquired by "delete_volume" :: waited 0.024s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:41:17 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f037071c-b091-424b-ad92-38d76e7e169d]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:41:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9f7c2915-c265-4863-bc48-40c8220211d7 tempest-GroupsTest-1595542360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-96ec9027-0ef1-4fbd-9677-67e0eb30bea0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:18 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-96ec9027-0ef1-4fbd-9677-67e0eb30bea0 Sep 05 11:41:18 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:18 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:41:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] Flow 'volume_create_manager' (aa1aac33-6eb5-4e29-901d-93838770d445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:41:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (683d55b9-59e4-4428-80c9-9282efb661ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (683d55b9-59e4-4428-80c9-9282efb661ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:41:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1566834727',display_name='tempest-VolumesGetTest-Volume-1001612980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85855436-3229-4f72-9ee1-41a48224df8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1fe7e365b1d48b2b9580f4796bbea42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:41:18Z,use_quota=True,user_id='d467b9677fb64570a0d79e0680ac33d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d462c4-dd6b-46f7-91db-83280d907ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d462c4-dd6b-46f7-91db-83280d907ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967a691d-8993-44d3-a115-b51568080d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967a691d-8993-44d3-a115-b51568080d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85855436-3229-4f72-9ee1-41a48224df8e', 'volume_name': 'volume-85855436-3229-4f72-9ee1-41a48224df8e', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1497f148-6faf-4e9e-9131-2512cfcb5d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1497f148-6faf-4e9e-9131-2512cfcb5d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e9eb5f-29da-4093-9c60-ae5e4844c81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:18 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] Volume 85855436-3229-4f72-9ee1-41a48224df8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85855436-3229-4f72-9ee1-41a48224df8e', 'volume_size': 1} Sep 05 11:41:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:41:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:41:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:41:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1566834727',display_name='tempest-VolumesGetTest-Volume-1001612980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85855436-3229-4f72-9ee1-41a48224df8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1fe7e365b1d48b2b9580f4796bbea42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:41:18Z,use_quota=True,user_id='d467b9677fb64570a0d79e0680ac33d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:41:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] Creating volume 85855436-3229-4f72-9ee1-41a48224df8e {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:41:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:41:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:41:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:41:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:41:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:41:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:41:18 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:41:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85855436-3229-4f72-9ee1-41a48224df8e 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:18 devstack sudo[98107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85855436-3229-4f72-9ee1-41a48224df8e 1073741824 Sep 05 11:41:18 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:18 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9f7c2915-c265-4863-bc48-40c8220211d7 tempest-GroupsTest-1595542360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-96ec9027-0ef1-4fbd-9677-67e0eb30bea0" returned: 0 in 0.443s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9f7c2915-c265-4863-bc48-40c8220211d7 tempest-GroupsTest-1595542360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-96ec9027-0ef1-4fbd-9677-67e0eb30bea0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:18 devstack sudo[98109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-96ec9027-0ef1-4fbd-9677-67e0eb30bea0 Sep 05 11:41:18 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:18 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9f7c2915-c265-4863-bc48-40c8220211d7 tempest-GroupsTest-1595542360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-96ec9027-0ef1-4fbd-9677-67e0eb30bea0" returned: 0 in 0.241s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9f7c2915-c265-4863-bc48-40c8220211d7 tempest-GroupsTest-1595542360 None] Lock "cinder-quobyte-96ec9027-0ef1-4fbd-9677-67e0eb30bea0" released by "delete_volume" :: held 0.742s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:41:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9f7c2915-c265-4863-bc48-40c8220211d7 tempest-GroupsTest-1595542360 None] Acquiring lock "cinder-quobyte-ed94d031-a6c5-4eb7-b019-7b313e610138" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:41:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9f7c2915-c265-4863-bc48-40c8220211d7 tempest-GroupsTest-1595542360 None] Lock "cinder-quobyte-ed94d031-a6c5-4eb7-b019-7b313e610138" acquired by "delete_volume" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:41:18 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[af651d7e-1b56-4d40-829d-d840b6dafa8c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:41:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9f7c2915-c265-4863-bc48-40c8220211d7 tempest-GroupsTest-1595542360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ed94d031-a6c5-4eb7-b019-7b313e610138 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:18 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ed94d031-a6c5-4eb7-b019-7b313e610138 Sep 05 11:41:18 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:18 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85855436-3229-4f72-9ee1-41a48224df8e 1073741824" returned: 0 in 0.453s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85855436-3229-4f72-9ee1-41a48224df8e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:18 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85855436-3229-4f72-9ee1-41a48224df8e Sep 05 11:41:18 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:19 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85855436-3229-4f72-9ee1-41a48224df8e" returned: 0 in 0.331s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:41:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:41:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e9eb5f-29da-4093-9c60-ae5e4844c81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85855436-3229-4f72-9ee1-41a48224df8e', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01c76a22-5656-40b5-a6b4-a5f2c62dabbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:19 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:19 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] Volume volume-85855436-3229-4f72-9ee1-41a48224df8e (85855436-3229-4f72-9ee1-41a48224df8e): created successfully Sep 05 11:41:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01c76a22-5656-40b5-a6b4-a5f2c62dabbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] Flow 'volume_create_manager' (aa1aac33-6eb5-4e29-901d-93838770d445) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:41:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9f7c2915-c265-4863-bc48-40c8220211d7 tempest-GroupsTest-1595542360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ed94d031-a6c5-4eb7-b019-7b313e610138" returned: 0 in 0.551s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9f7c2915-c265-4863-bc48-40c8220211d7 tempest-GroupsTest-1595542360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ed94d031-a6c5-4eb7-b019-7b313e610138 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:19 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6904fdab-6ea0-4ad0-8ebb-7a6d76431710 tempest-VolumesGetTest-997413188 None] Created volume successfully. Sep 05 11:41:19 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ed94d031-a6c5-4eb7-b019-7b313e610138 Sep 05 11:41:19 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:19 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9f7c2915-c265-4863-bc48-40c8220211d7 tempest-GroupsTest-1595542360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ed94d031-a6c5-4eb7-b019-7b313e610138" returned: 0 in 0.300s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9f7c2915-c265-4863-bc48-40c8220211d7 tempest-GroupsTest-1595542360 None] Lock "cinder-quobyte-ed94d031-a6c5-4eb7-b019-7b313e610138" released by "delete_volume" :: held 0.900s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:41:19 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-9f7c2915-c265-4863-bc48-40c8220211d7 tempest-GroupsTest-1595542360 None] Created reservations ['888a2f55-de2b-461e-8b5b-df2f474aa6a6'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:41:19 devstack cinder-volume[87517]: WARNING cinder.quota [None req-9f7c2915-c265-4863-bc48-40c8220211d7 tempest-GroupsTest-1595542360 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-488767886 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-488767886, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:41:19 devstack cinder-volume[87517]: WARNING cinder.quota [None req-9f7c2915-c265-4863-bc48-40c8220211d7 tempest-GroupsTest-1595542360 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-488767886 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-488767886, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:41:19 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-9f7c2915-c265-4863-bc48-40c8220211d7 tempest-GroupsTest-1595542360 None] Created reservations ['c2c5c622-9704-46d7-8d34-c4f975d682d7', '86856335-6bb5-4411-bef5-9520123fa9ba', '3bd1f484-36c9-4518-b6e8-c2a13f6bd9ac', '2b4325dc-dfce-4b95-9b9d-69e4ebbe430d'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:41:19 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-9f7c2915-c265-4863-bc48-40c8220211d7 tempest-GroupsTest-1595542360 None] Created reservations ['e3094c30-1179-40f1-807c-808b09ca5d9b', '4c59a479-0abd-4315-8f94-1ac25d873cec', '3cd501a4-c845-4250-b49b-f351975ceca8', '833da93f-c385-4252-8219-0ad5e3faf995'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:41:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9f7c2915-c265-4863-bc48-40c8220211d7 tempest-GroupsTest-1595542360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:41:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9f7c2915-c265-4863-bc48-40c8220211d7 tempest-GroupsTest-1595542360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:41:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9f7c2915-c265-4863-bc48-40c8220211d7 tempest-GroupsTest-1595542360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:41:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9f7c2915-c265-4863-bc48-40c8220211d7 tempest-GroupsTest-1595542360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:41:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9f7c2915-c265-4863-bc48-40c8220211d7 tempest-GroupsTest-1595542360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:41:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9f7c2915-c265-4863-bc48-40c8220211d7 tempest-GroupsTest-1595542360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:19 devstack sudo[98128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:41:19 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:20 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9f7c2915-c265-4863-bc48-40c8220211d7 tempest-GroupsTest-1595542360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.253s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:20 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-9f7c2915-c265-4863-bc48-40c8220211d7 tempest-GroupsTest-1595542360 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:41:20 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-9f7c2915-c265-4863-bc48-40c8220211d7 tempest-GroupsTest-1595542360 None] Delete group completed successfully. Sep 05 11:41:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d3f1120f-83ee-495b-b857-bd1811b85bcd tempest-VolumesGetTest-997413188 None] Acquiring lock "cinder-85855436-3229-4f72-9ee1-41a48224df8e-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:41:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d3f1120f-83ee-495b-b857-bd1811b85bcd tempest-VolumesGetTest-997413188 None] Lock "cinder-85855436-3229-4f72-9ee1-41a48224df8e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:41:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d3f1120f-83ee-495b-b857-bd1811b85bcd tempest-VolumesGetTest-997413188 None] Acquiring lock "cinder-quobyte-85855436-3229-4f72-9ee1-41a48224df8e" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:41:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d3f1120f-83ee-495b-b857-bd1811b85bcd tempest-VolumesGetTest-997413188 None] Lock "cinder-quobyte-85855436-3229-4f72-9ee1-41a48224df8e" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:41:20 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a7f209-991b-4196-95c1-e21d3b433223]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:41:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d3f1120f-83ee-495b-b857-bd1811b85bcd tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85855436-3229-4f72-9ee1-41a48224df8e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:20 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85855436-3229-4f72-9ee1-41a48224df8e Sep 05 11:41:20 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:21 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d3f1120f-83ee-495b-b857-bd1811b85bcd tempest-VolumesGetTest-997413188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85855436-3229-4f72-9ee1-41a48224df8e" returned: 0 in 0.436s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d3f1120f-83ee-495b-b857-bd1811b85bcd tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85855436-3229-4f72-9ee1-41a48224df8e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:21 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85855436-3229-4f72-9ee1-41a48224df8e Sep 05 11:41:21 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:21 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d3f1120f-83ee-495b-b857-bd1811b85bcd tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85855436-3229-4f72-9ee1-41a48224df8e" returned: 0 in 0.267s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d3f1120f-83ee-495b-b857-bd1811b85bcd tempest-VolumesGetTest-997413188 None] Lock "cinder-quobyte-85855436-3229-4f72-9ee1-41a48224df8e" released by "delete_volume" :: held 0.751s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:41:21 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-d3f1120f-83ee-495b-b857-bd1811b85bcd tempest-VolumesGetTest-997413188 None] Created reservations ['a7502ad6-7f5a-4e10-bf13-186f865b12a0', '6138fdf6-4eab-47b6-a336-97b7c14cfdff', '83f2d908-1b4d-4f37-8fa3-cb5ffa7017cb', '438b8992-976e-491b-981f-8bf949c42b31'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:41:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d3f1120f-83ee-495b-b857-bd1811b85bcd tempest-VolumesGetTest-997413188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:41:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d3f1120f-83ee-495b-b857-bd1811b85bcd tempest-VolumesGetTest-997413188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:41:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d3f1120f-83ee-495b-b857-bd1811b85bcd tempest-VolumesGetTest-997413188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:41:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d3f1120f-83ee-495b-b857-bd1811b85bcd tempest-VolumesGetTest-997413188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:41:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d3f1120f-83ee-495b-b857-bd1811b85bcd tempest-VolumesGetTest-997413188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:41:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d3f1120f-83ee-495b-b857-bd1811b85bcd tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:21 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:41:21 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-af665860-7c27-41e3-8b83-1f623f2451ce tempest-VolumesGetTest-997413188 None] Acquiring lock "cinder-1386441e-e9c8-4a32-af7f-5ef7204cf29b-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:41:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-af665860-7c27-41e3-8b83-1f623f2451ce tempest-VolumesGetTest-997413188 None] Lock "cinder-1386441e-e9c8-4a32-af7f-5ef7204cf29b-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:41:22 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d3f1120f-83ee-495b-b857-bd1811b85bcd tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.378s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:22 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-d3f1120f-83ee-495b-b857-bd1811b85bcd tempest-VolumesGetTest-997413188 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:41:22 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d3f1120f-83ee-495b-b857-bd1811b85bcd tempest-VolumesGetTest-997413188 None] Deleted volume successfully. Sep 05 11:41:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-af665860-7c27-41e3-8b83-1f623f2451ce tempest-VolumesGetTest-997413188 None] Acquiring lock "cinder-quobyte-1386441e-e9c8-4a32-af7f-5ef7204cf29b" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:41:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d3f1120f-83ee-495b-b857-bd1811b85bcd tempest-VolumesGetTest-997413188 None] Lock "cinder-85855436-3229-4f72-9ee1-41a48224df8e-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:41:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-af665860-7c27-41e3-8b83-1f623f2451ce tempest-VolumesGetTest-997413188 None] Lock "cinder-quobyte-1386441e-e9c8-4a32-af7f-5ef7204cf29b" acquired by "delete_volume" :: waited 0.033s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:41:22 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[370b3f3d-35d5-4b0c-a57c-ed0d9d2333fe]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:41:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-af665860-7c27-41e3-8b83-1f623f2451ce tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1386441e-e9c8-4a32-af7f-5ef7204cf29b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:22 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1386441e-e9c8-4a32-af7f-5ef7204cf29b Sep 05 11:41:22 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:22 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-af665860-7c27-41e3-8b83-1f623f2451ce tempest-VolumesGetTest-997413188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1386441e-e9c8-4a32-af7f-5ef7204cf29b" returned: 0 in 0.451s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-af665860-7c27-41e3-8b83-1f623f2451ce tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1386441e-e9c8-4a32-af7f-5ef7204cf29b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:22 devstack sudo[98150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1386441e-e9c8-4a32-af7f-5ef7204cf29b Sep 05 11:41:22 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:22 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-af665860-7c27-41e3-8b83-1f623f2451ce tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1386441e-e9c8-4a32-af7f-5ef7204cf29b" returned: 0 in 0.314s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-af665860-7c27-41e3-8b83-1f623f2451ce tempest-VolumesGetTest-997413188 None] Lock "cinder-quobyte-1386441e-e9c8-4a32-af7f-5ef7204cf29b" released by "delete_volume" :: held 0.832s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:41:22 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-af665860-7c27-41e3-8b83-1f623f2451ce tempest-VolumesGetTest-997413188 None] Created reservations ['93fb3aff-0e6d-470d-8c61-aa3a3182060e', '7e1e35d4-b225-4cc5-b468-0aa23281ddd5', '1965b8e3-7e29-492f-860a-65f09e7a7718', '2207df2c-26e7-4648-8151-53d093c2ad0e'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:41:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-af665860-7c27-41e3-8b83-1f623f2451ce tempest-VolumesGetTest-997413188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:41:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-af665860-7c27-41e3-8b83-1f623f2451ce tempest-VolumesGetTest-997413188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:41:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-af665860-7c27-41e3-8b83-1f623f2451ce tempest-VolumesGetTest-997413188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:41:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-af665860-7c27-41e3-8b83-1f623f2451ce tempest-VolumesGetTest-997413188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:41:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-af665860-7c27-41e3-8b83-1f623f2451ce tempest-VolumesGetTest-997413188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:41:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-af665860-7c27-41e3-8b83-1f623f2451ce tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:23 devstack sudo[98153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:41:23 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:23 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-af665860-7c27-41e3-8b83-1f623f2451ce tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.320s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:23 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-af665860-7c27-41e3-8b83-1f623f2451ce tempest-VolumesGetTest-997413188 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:41:23 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-af665860-7c27-41e3-8b83-1f623f2451ce tempest-VolumesGetTest-997413188 None] Deleted volume successfully. Sep 05 11:41:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-af665860-7c27-41e3-8b83-1f623f2451ce tempest-VolumesGetTest-997413188 None] Lock "cinder-1386441e-e9c8-4a32-af7f-5ef7204cf29b-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:41:23 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:41:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] Flow 'volume_create_manager' (99da807f-cd30-44bc-a808-7ae05febf8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:41:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd1b1be1-54d3-4d7a-9cdd-56a88b7b8ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd1b1be1-54d3-4d7a-9cdd-56a88b7b8ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-459315610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d2dbb52-8180-49cf-91f8-f5ff476db1da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1fe7e365b1d48b2b9580f4796bbea42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:41:24Z,use_quota=True,user_id='d467b9677fb64570a0d79e0680ac33d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e3eeb3f-6a95-47ad-b7bf-d2deca9b2cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e3eeb3f-6a95-47ad-b7bf-d2deca9b2cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (106420cf-10c1-4cf3-ad4c-492a7dd99ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (106420cf-10c1-4cf3-ad4c-492a7dd99ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d2dbb52-8180-49cf-91f8-f5ff476db1da', 'volume_name': 'volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1ac03c9-c0f8-41da-a739-49d22d2d1b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1ac03c9-c0f8-41da-a739-49d22d2d1b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9d679f0-ff54-4d7d-8f29-f0603b20f6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:23 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] Volume 3d2dbb52-8180-49cf-91f8-f5ff476db1da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da', 'volume_size': 1} Sep 05 11:41:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:41:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:41:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-459315610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d2dbb52-8180-49cf-91f8-f5ff476db1da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1fe7e365b1d48b2b9580f4796bbea42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:41:24Z,use_quota=True,user_id='d467b9677fb64570a0d79e0680ac33d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:41:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] Creating volume 3d2dbb52-8180-49cf-91f8-f5ff476db1da {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:41:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:41:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:41:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:41:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:41:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:41:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:41:23 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:41:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:23 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da 1073741824 Sep 05 11:41:23 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:24 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da 1073741824" returned: 0 in 0.502s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:24 devstack sudo[98164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da Sep 05 11:41:24 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:24 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da" returned: 0 in 0.350s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:41:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:41:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9d679f0-ff54-4d7d-8f29-f0603b20f6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e5f16cf-fd7b-44f9-a733-a6543b2b147a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:24 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] Volume volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da (3d2dbb52-8180-49cf-91f8-f5ff476db1da): created successfully Sep 05 11:41:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e5f16cf-fd7b-44f9-a733-a6543b2b147a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] Flow 'volume_create_manager' (99da807f-cd30-44bc-a808-7ae05febf8a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:41:24 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-78bec720-f75e-488a-86f1-63f9a4f51336 tempest-VolumesGetTest-997413188 None] Created volume successfully. Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] Flow 'volume_create_manager' (1a2cf4b8-22fb-44e4-b08d-2fd5a62daf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6ba726c-b8a0-4fbb-b0a0-900db46c54b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6ba726c-b8a0-4fbb-b0a0-900db46c54b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1153026700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db4a0fb7-5219-49e9-b3e6-9958a047e191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6213ac78fb49da82eb2c54d162283c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:41:26Z,use_quota=True,user_id='23030638789a4b8382ae3ee25b6e8d2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8db7d6-8ae9-464d-9601-a9b59585dada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8db7d6-8ae9-464d-9601-a9b59585dada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df2e6e68-e8d5-40a6-b891-70607908278a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df2e6e68-e8d5-40a6-b891-70607908278a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db4a0fb7-5219-49e9-b3e6-9958a047e191', 'volume_name': 'volume-db4a0fb7-5219-49e9-b3e6-9958a047e191', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c845869-7147-4148-8bdd-cd91c879fc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c845869-7147-4148-8bdd-cd91c879fc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1b9468-2e3c-418c-9272-881c415f3909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:26 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] Volume db4a0fb7-5219-49e9-b3e6-9958a047e191: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db4a0fb7-5219-49e9-b3e6-9958a047e191', 'volume_size': 1} Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1153026700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db4a0fb7-5219-49e9-b3e6-9958a047e191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6213ac78fb49da82eb2c54d162283c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:41:26Z,use_quota=True,user_id='23030638789a4b8382ae3ee25b6e8d2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] Creating volume db4a0fb7-5219-49e9-b3e6-9958a047e191 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:41:26 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-db4a0fb7-5219-49e9-b3e6-9958a047e191 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:26 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-db4a0fb7-5219-49e9-b3e6-9958a047e191 1073741824 Sep 05 11:41:26 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Flow 'volume_create_manager' (0a50e233-c641-42cb-8885-7076cfcae36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (944e5b72-02b7-42c3-a530-954ef46e4ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (944e5b72-02b7-42c3-a530-954ef46e4ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2097448100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c942c94-f1d2-4eae-a5b9-100cefaaa1e1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c1fe7e365b1d48b2b9580f4796bbea42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=3d2dbb52-8180-49cf-91f8-f5ff476db1da,status='creating',terminated_at=None,updated_at=2026-09-05T09:41:27Z,use_quota=True,user_id='d467b9677fb64570a0d79e0680ac33d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fda0b6c-712b-4af0-8309-66ac24153f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fda0b6c-712b-4af0-8309-66ac24153f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ee6f8ef-a39f-4424-beab-705c0c03c4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ee6f8ef-a39f-4424-beab-705c0c03c4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7c942c94-f1d2-4eae-a5b9-100cefaaa1e1', 'volume_name': 'volume-7c942c94-f1d2-4eae-a5b9-100cefaaa1e1', 'volume_size': 1, 'source_volid': '3d2dbb52-8180-49cf-91f8-f5ff476db1da', 'source_volstatus': 'available'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (633c53b7-c305-48c0-b373-20d5581d34d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (633c53b7-c305-48c0-b373-20d5581d34d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f09b5ba-935f-4da6-91ea-7ba6b12b9aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:26 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Volume 7c942c94-f1d2-4eae-a5b9-100cefaaa1e1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7c942c94-f1d2-4eae-a5b9-100cefaaa1e1', 'volume_size': 1, 'source_volid': '3d2dbb52-8180-49cf-91f8-f5ff476db1da', 'source_volstatus': 'available'} Sep 05 11:41:26 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-db4a0fb7-5219-49e9-b3e6-9958a047e191 1073741824" returned: 0 in 0.506s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:41:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-db4a0fb7-5219-49e9-b3e6-9958a047e191 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:26 devstack sudo[98174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-db4a0fb7-5219-49e9-b3e6-9958a047e191 Sep 05 11:41:26 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:27 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-db4a0fb7-5219-49e9-b3e6-9958a047e191" returned: 0 in 0.246s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:41:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:41:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.277s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:41:27 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Cloning volume 3d2dbb52-8180-49cf-91f8-f5ff476db1da to volume 7c942c94-f1d2-4eae-a5b9-100cefaaa1e1 Sep 05 11:41:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1b9468-2e3c-418c-9272-881c415f3909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db4a0fb7-5219-49e9-b3e6-9958a047e191', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8deeb31-f62a-4100-866e-400d40dacbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:27 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] Volume volume-db4a0fb7-5219-49e9-b3e6-9958a047e191 (db4a0fb7-5219-49e9-b3e6-9958a047e191): created successfully Sep 05 11:41:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8deeb31-f62a-4100-866e-400d40dacbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] Flow 'volume_create_manager' (1a2cf4b8-22fb-44e4-b08d-2fd5a62daf5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:41:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Creating offline snapshot 94b21431-7547-4734-8277-b1c7b9b641eb of volume 3d2dbb52-8180-49cf-91f8-f5ff476db1da {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:41:27 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-9c5fce4c-6b3c-4d8d-a94d-1570583ba0d6 tempest-TestImageHashVerification-12227837 None] Created volume successfully. Sep 05 11:41:27 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5e8673-a437-4e6f-9055-fc2472e5b870]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:41:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:27 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da Sep 05 11:41:27 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:27 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da" returned: 0 in 0.384s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da.94b21431-7547-4734-8277-b1c7b9b641eb 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:27 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da.94b21431-7547-4734-8277-b1c7b9b641eb 1G Sep 05 11:41:27 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:27 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da.94b21431-7547-4734-8277-b1c7b9b641eb 1G" returned: 0 in 0.427s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da.94b21431-7547-4734-8277-b1c7b9b641eb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:28 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da.94b21431-7547-4734-8277-b1c7b9b641eb Sep 05 11:41:28 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:28 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a5784bd4-6f7f-4e72-b8e0-0d07038326ba tempest-GroupsV320Test-1666367598 None] Group tempest-GroupsV320Test-Group-940058925: creating Sep 05 11:41:28 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a5784bd4-6f7f-4e72-b8e0-0d07038326ba tempest-GroupsV320Test-1666367598 None] Group tempest-GroupsV320Test-Group-940058925: created successfully Sep 05 11:41:28 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a5784bd4-6f7f-4e72-b8e0-0d07038326ba tempest-GroupsV320Test-1666367598 None] Create group completed successfully. Sep 05 11:41:28 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da.94b21431-7547-4734-8277-b1c7b9b641eb" returned: 0 in 0.308s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:28 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da.94b21431-7547-4734-8277-b1c7b9b641eb is being set with open permissions: ugo+rw Sep 05 11:41:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da.94b21431-7547-4734-8277-b1c7b9b641eb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:28 devstack sudo[98193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da.94b21431-7547-4734-8277-b1c7b9b641eb Sep 05 11:41:28 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:28 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da.94b21431-7547-4734-8277-b1c7b9b641eb" returned: 0 in 0.237s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:28 devstack sudo[98206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da.info Sep 05 11:41:28 devstack sudo[98206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:28 devstack sudo[98206]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da.info" returned: 0 in 0.306s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:28 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da.info is being set with open permissions: ugo+rw Sep 05 11:41:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:28 devstack sudo[98235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da.info Sep 05 11:41:28 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:29 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da.info" returned: 0 in 0.316s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Acquiring lock "cinder-quobyte-7c942c94-f1d2-4eae-a5b9-100cefaaa1e1" by "_copy_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:41:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Lock "cinder-quobyte-7c942c94-f1d2-4eae-a5b9-100cefaaa1e1" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:41:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] snapshot: 94b21431-7547-4734-8277-b1c7b9b641eb, volume: 7c942c94-f1d2-4eae-a5b9-100cefaaa1e1, {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 11:41:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:41:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:41:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:41:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:41:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:41:29 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfe44c8-eebb-4b36-9a84-898b9fbbef55]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:41:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da.94b21431-7547-4734-8277-b1c7b9b641eb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:29 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da.94b21431-7547-4734-8277-b1c7b9b641eb Sep 05 11:41:29 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cdffdb45-9824-42b1-b480-62f23c760010 tempest-TestImageHashVerification-12227837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:41:29 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-57b7c99b-3d67-467b-aad2-d1411dc58b18 tempest-GroupsV320Test-1666367598 None] Created reservations ['935d5e79-ed69-4144-9eed-631f9662c156'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:41:29 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da.94b21431-7547-4734-8277-b1c7b9b641eb" returned: 0 in 0.409s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:41:29 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc5a1d8-f7bd-4773-812b-f439c5eab96d]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:41:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-57b7c99b-3d67-467b-aad2-d1411dc58b18 tempest-GroupsV320Test-1666367598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:41:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-57b7c99b-3d67-467b-aad2-d1411dc58b18 tempest-GroupsV320Test-1666367598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:41:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-57b7c99b-3d67-467b-aad2-d1411dc58b18 tempest-GroupsV320Test-1666367598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:41:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-57b7c99b-3d67-467b-aad2-d1411dc58b18 tempest-GroupsV320Test-1666367598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:41:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-57b7c99b-3d67-467b-aad2-d1411dc58b18 tempest-GroupsV320Test-1666367598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:41:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-57b7c99b-3d67-467b-aad2-d1411dc58b18 tempest-GroupsV320Test-1666367598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:29 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:41:29 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:29 devstack sudo[98243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da Sep 05 11:41:29 devstack sudo[98243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:30 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-57b7c99b-3d67-467b-aad2-d1411dc58b18 tempest-GroupsV320Test-1666367598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.252s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:30 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-57b7c99b-3d67-467b-aad2-d1411dc58b18 tempest-GroupsV320Test-1666367598 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:41:30 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-57b7c99b-3d67-467b-aad2-d1411dc58b18 tempest-GroupsV320Test-1666367598 None] Delete group completed successfully. Sep 05 11:41:30 devstack sudo[98243]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da" returned: 0 in 0.363s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 11:41:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Creating direct copy from snapshot {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 11:41:30 devstack cinder-volume[87517]: DEBUG cinder.utils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Path /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7c942c94-f1d2-4eae-a5b9-100cefaaa1e1 not found in is_blk_device check {{(pid=87517) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 11:41:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7c942c94-f1d2-4eae-a5b9-100cefaaa1e1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:30 devstack sudo[98251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7c942c94-f1d2-4eae-a5b9-100cefaaa1e1 Sep 05 11:41:30 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:41:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:41:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:41:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:41:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:41:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:41:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:32 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:41:32 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:32 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.733s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:32 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:41:33 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:41:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread count: 28 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 11:41:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread info: [<_MainThread(MainThread, started 131707869511808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 11:41:35 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7c942c94-f1d2-4eae-a5b9-100cefaaa1e1" returned: 0 in 5.442s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:35 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Image conversion details: src /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da, size 1024.00 MB, duration 5.44 sec, destination /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7c942c94-f1d2-4eae-a5b9-100cefaaa1e1 {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 11:41:35 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Converted 1024.00 MB image at 188.14 MB/s Sep 05 11:41:35 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7c942c94-f1d2-4eae-a5b9-100cefaaa1e1 is being set with open permissions: ugo+rw Sep 05 11:41:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7c942c94-f1d2-4eae-a5b9-100cefaaa1e1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:35 devstack sudo[98269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7c942c94-f1d2-4eae-a5b9-100cefaaa1e1 Sep 05 11:41:35 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:35 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7c942c94-f1d2-4eae-a5b9-100cefaaa1e1" returned: 0 in 0.282s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Lock "cinder-quobyte-7c942c94-f1d2-4eae-a5b9-100cefaaa1e1" released by "_copy_volume_from_snapshot" :: held 6.577s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:41:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Acquiring lock "cinder-quobyte-94b21431-7547-4734-8277-b1c7b9b641eb" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:41:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Lock "cinder-quobyte-94b21431-7547-4734-8277-b1c7b9b641eb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:41:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Deleting offline snapshot 94b21431-7547-4734-8277-b1c7b9b641eb of volume 3d2dbb52-8180-49cf-91f8-f5ff476db1da {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:41:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] snapshot_file for this snap is: volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da.94b21431-7547-4734-8277-b1c7b9b641eb {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:41:35 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f64c862-8c7d-4548-b050-3b21900ce55f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:41:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da.94b21431-7547-4734-8277-b1c7b9b641eb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:36 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da.94b21431-7547-4734-8277-b1c7b9b641eb Sep 05 11:41:36 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:36 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da.94b21431-7547-4734-8277-b1c7b9b641eb" returned: 0 in 0.453s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:41:36 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[74041785-54cb-44e7-a099-1b65fb8f4ba1]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:41:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:36 devstack sudo[98277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da Sep 05 11:41:36 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:36 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da" returned: 0 in 0.586s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da.94b21431-7547-4734-8277-b1c7b9b641eb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:37 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da.94b21431-7547-4734-8277-b1c7b9b641eb Sep 05 11:41:37 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:37 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da.94b21431-7547-4734-8277-b1c7b9b641eb" returned: 0 in 0.367s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da.94b21431-7547-4734-8277-b1c7b9b641eb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:37 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da.94b21431-7547-4734-8277-b1c7b9b641eb Sep 05 11:41:37 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:37 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da.94b21431-7547-4734-8277-b1c7b9b641eb" returned: 0 in 0.256s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Lock "cinder-quobyte-94b21431-7547-4734-8277-b1c7b9b641eb" released by "_delete_snapshot" :: held 1.789s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:41:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.606s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:41:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cdffdb45-9824-42b1-b480-62f23c760010 tempest-TestImageHashVerification-12227837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 8.181s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:41:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f09b5ba-935f-4da6-91ea-7ba6b12b9aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c942c94-f1d2-4eae-a5b9-100cefaaa1e1', 'volume_size': 1, 'source_volid': '3d2dbb52-8180-49cf-91f8-f5ff476db1da', 'source_volstatus': 'available'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79aadfc9-bad6-40d0-bb53-1e5d25317e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:37 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f746768-6a42-4a55-8212-f477f48ce431]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:41:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdffdb45-9824-42b1-b480-62f23c760010 tempest-TestImageHashVerification-12227837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-db4a0fb7-5219-49e9-b3e6-9958a047e191 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:37 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Volume volume-7c942c94-f1d2-4eae-a5b9-100cefaaa1e1 (7c942c94-f1d2-4eae-a5b9-100cefaaa1e1): created successfully Sep 05 11:41:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79aadfc9-bad6-40d0-bb53-1e5d25317e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Flow 'volume_create_manager' (0a50e233-c641-42cb-8885-7076cfcae36e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:41:37 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-595bfd00-4477-4348-859e-990827381f49 tempest-VolumesGetTest-997413188 None] Created volume successfully. Sep 05 11:41:37 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-db4a0fb7-5219-49e9-b3e6-9958a047e191 Sep 05 11:41:37 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:38 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdffdb45-9824-42b1-b480-62f23c760010 tempest-TestImageHashVerification-12227837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-db4a0fb7-5219-49e9-b3e6-9958a047e191" returned: 0 in 0.396s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:38 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38e3f1e-bb83-4ec8-9412-18d6beec2403]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:41:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdffdb45-9824-42b1-b480-62f23c760010 tempest-TestImageHashVerification-12227837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-db4a0fb7-5219-49e9-b3e6-9958a047e191 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:38 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-db4a0fb7-5219-49e9-b3e6-9958a047e191 Sep 05 11:41:38 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:38 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdffdb45-9824-42b1-b480-62f23c760010 tempest-TestImageHashVerification-12227837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-db4a0fb7-5219-49e9-b3e6-9958a047e191" returned: 0 in 0.392s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdffdb45-9824-42b1-b480-62f23c760010 tempest-TestImageHashVerification-12227837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-db4a0fb7-5219-49e9-b3e6-9958a047e191 /opt/stack/data/cinder/conversion/db4a0fb7-5219-49e9-b3e6-9958a047e191.temp_image.1855dfe1-3d2f-4487-a8ab-accd7dd496486nryrxwk.img {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:38 devstack sudo[98302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-db4a0fb7-5219-49e9-b3e6-9958a047e191 /opt/stack/data/cinder/conversion/db4a0fb7-5219-49e9-b3e6-9958a047e191.temp_image.1855dfe1-3d2f-4487-a8ab-accd7dd496486nryrxwk.img Sep 05 11:41:38 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:40 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:41:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] Flow 'volume_create_manager' (c1244ef9-6ba2-4b66-a221-648ce5202c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:41:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd7b1051-0f0d-41e1-a010-4e568c114087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd7b1051-0f0d-41e1-a010-4e568c114087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:41:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1443967781',display_name='tempest-VolumesGetTest-Volume-1893262802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10d5f59f-8cc1-4b79-b6f7-d51cd4b43a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1fe7e365b1d48b2b9580f4796bbea42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:41:40Z,use_quota=True,user_id='d467b9677fb64570a0d79e0680ac33d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50fab3cf-6b4c-4f87-a9bc-5d7f3a5b1ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50fab3cf-6b4c-4f87-a9bc-5d7f3a5b1ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a056190b-1dff-4edc-b14b-0aed74b1e8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a056190b-1dff-4edc-b14b-0aed74b1e8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10d5f59f-8cc1-4b79-b6f7-d51cd4b43a46', 'volume_name': 'volume-10d5f59f-8cc1-4b79-b6f7-d51cd4b43a46', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72785d61-7667-4b98-a910-cb07d279b8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72785d61-7667-4b98-a910-cb07d279b8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e00b9fe-347d-4f52-9580-7a2bf1b8d605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:40 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] Volume 10d5f59f-8cc1-4b79-b6f7-d51cd4b43a46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10d5f59f-8cc1-4b79-b6f7-d51cd4b43a46', 'volume_size': 1} Sep 05 11:41:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:41:43 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdffdb45-9824-42b1-b480-62f23c760010 tempest-TestImageHashVerification-12227837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-db4a0fb7-5219-49e9-b3e6-9958a047e191 /opt/stack/data/cinder/conversion/db4a0fb7-5219-49e9-b3e6-9958a047e191.temp_image.1855dfe1-3d2f-4487-a8ab-accd7dd496486nryrxwk.img" returned: 0 in 5.129s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:43 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5e39a5-0548-49f0-a207-673cdde120f2]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:41:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdffdb45-9824-42b1-b480-62f23c760010 tempest-TestImageHashVerification-12227837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-db4a0fb7-5219-49e9-b3e6-9958a047e191 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:41:43 devstack sudo[98316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-db4a0fb7-5219-49e9-b3e6-9958a047e191 Sep 05 11:41:43 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:41:44 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root Sep 05 11:41:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cdffdb45-9824-42b1-b480-62f23c760010 tempest-TestImageHashVerification-12227837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-db4a0fb7-5219-49e9-b3e6-9958a047e191" returned: 0 in 0.601s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:41:44 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-cdffdb45-9824-42b1-b480-62f23c760010 tempest-TestImageHashVerification-12227837 None] Image conversion details: src /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-db4a0fb7-5219-49e9-b3e6-9958a047e191, size 1024.00 MB, duration 5.13 sec, destination /opt/stack/data/cinder/conversion/db4a0fb7-5219-49e9-b3e6-9958a047e191.temp_image.1855dfe1-3d2f-4487-a8ab-accd7dd496486nryrxwk.img {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 11:41:44 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-cdffdb45-9824-42b1-b480-62f23c760010 tempest-TestImageHashVerification-12227837 None] Converted 1024.00 MB image at 199.60 MB/s Sep 05 11:41:44 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-cdffdb45-9824-42b1-b480-62f23c760010 tempest-TestImageHashVerification-12227837 None] 1855dfe1-3d2f-4487-a8ab-accd7dd49648 was raw, no need to convert to raw {{(pid=87517) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 05 11:41:50 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=64,cinder:SELECT=44,cinder:DELETE=3,cinder:INSERT=10 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:41:54 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:DELETE=6,cinder:UPDATE=54,cinder:SELECT=56,cinder:INSERT=16 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:41:55 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:41:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Flow 'volume_create_manager' (91314815-dce6-4a5c-bfdd-1eccbbb04125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:41:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef021ceb-a76f-410c-98ec-afb13cd28174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef021ceb-a76f-410c-98ec-afb13cd28174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2004026775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d4bb9bd-4048-4ca0-ad95-0c74eee5a2a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6b1480f927345d28482c1944bb7b8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:41:55Z,use_quota=True,user_id='631c11cc43ff41298f2e7595828c690e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (985756b9-f017-4614-ba5a-376215607cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (985756b9-f017-4614-ba5a-376215607cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c4a3c3-8c3a-4c9c-9978-8b2df977b900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c4a3c3-8c3a-4c9c-9978-8b2df977b900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d4bb9bd-4048-4ca0-ad95-0c74eee5a2a1', 'volume_name': 'volume-2d4bb9bd-4048-4ca0-ad95-0c74eee5a2a1', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (640f7edf-bf5e-41e2-9f36-da45e6565ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (640f7edf-bf5e-41e2-9f36-da45e6565ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:41:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (509eb16d-ca08-4158-a7e3-bb10c79eaf30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:41:55 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Volume 2d4bb9bd-4048-4ca0-ad95-0c74eee5a2a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d4bb9bd-4048-4ca0-ad95-0c74eee5a2a1', 'volume_size': 1} Sep 05 11:41:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:42:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cdffdb45-9824-42b1-b480-62f23c760010 tempest-TestImageHashVerification-12227837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.805s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:42:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cdffdb45-9824-42b1-b480-62f23c760010 tempest-TestImageHashVerification-12227837 None] Uploaded volume to glance image-id: 1855dfe1-3d2f-4487-a8ab-accd7dd49648. {{(pid=87517) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 05 11:42:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.929s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:42:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:41:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1443967781',display_name='tempest-VolumesGetTest-Volume-1893262802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10d5f59f-8cc1-4b79-b6f7-d51cd4b43a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1fe7e365b1d48b2b9580f4796bbea42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:41:40Z,use_quota=True,user_id='d467b9677fb64570a0d79e0680ac33d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:42:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] Creating volume 10d5f59f-8cc1-4b79-b6f7-d51cd4b43a46 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:42:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:42:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:42:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:42:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:42:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:42:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:42:04 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:42:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-10d5f59f-8cc1-4b79-b6f7-d51cd4b43a46 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:04 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-10d5f59f-8cc1-4b79-b6f7-d51cd4b43a46 1073741824 Sep 05 11:42:04 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:04 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-cdffdb45-9824-42b1-b480-62f23c760010 tempest-TestImageHashVerification-12227837 None] Copy volume to image completed successfully. Sep 05 11:42:04 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-10d5f59f-8cc1-4b79-b6f7-d51cd4b43a46 1073741824" returned: 0 in 0.413s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-10d5f59f-8cc1-4b79-b6f7-d51cd4b43a46 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:04 devstack sudo[98336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-10d5f59f-8cc1-4b79-b6f7-d51cd4b43a46 Sep 05 11:42:04 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:05 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-10d5f59f-8cc1-4b79-b6f7-d51cd4b43a46" returned: 0 in 0.255s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:42:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:42:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.627s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:42:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2004026775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d4bb9bd-4048-4ca0-ad95-0c74eee5a2a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6b1480f927345d28482c1944bb7b8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:41:55Z,use_quota=True,user_id='631c11cc43ff41298f2e7595828c690e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:42:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Creating volume 2d4bb9bd-4048-4ca0-ad95-0c74eee5a2a1 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:42:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:42:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:42:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:42:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:42:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:42:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:42:05 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:42:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2d4bb9bd-4048-4ca0-ad95-0c74eee5a2a1 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:05 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2d4bb9bd-4048-4ca0-ad95-0c74eee5a2a1 1073741824 Sep 05 11:42:05 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e00b9fe-347d-4f52-9580-7a2bf1b8d605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10d5f59f-8cc1-4b79-b6f7-d51cd4b43a46', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (314892a5-6c7b-4fc3-8a85-543f8eea60d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:05 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] Volume volume-10d5f59f-8cc1-4b79-b6f7-d51cd4b43a46 (10d5f59f-8cc1-4b79-b6f7-d51cd4b43a46): created successfully Sep 05 11:42:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (314892a5-6c7b-4fc3-8a85-543f8eea60d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] Flow 'volume_create_manager' (c1244ef9-6ba2-4b66-a221-648ce5202c59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:42:05 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d5e930de-65cf-48d5-b61c-6db7423e9d1a tempest-VolumesGetTest-997413188 None] Created volume successfully. Sep 05 11:42:05 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2d4bb9bd-4048-4ca0-ad95-0c74eee5a2a1 1073741824" returned: 0 in 0.442s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2d4bb9bd-4048-4ca0-ad95-0c74eee5a2a1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:05 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2d4bb9bd-4048-4ca0-ad95-0c74eee5a2a1 Sep 05 11:42:05 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-03db7a40-cb5f-4365-8455-5b67105e9f73 tempest-TestImageHashVerification-12227837 None] Acquiring lock "cinder-db4a0fb7-5219-49e9-b3e6-9958a047e191-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:42:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-03db7a40-cb5f-4365-8455-5b67105e9f73 tempest-TestImageHashVerification-12227837 None] Lock "cinder-db4a0fb7-5219-49e9-b3e6-9958a047e191-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:42:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-03db7a40-cb5f-4365-8455-5b67105e9f73 tempest-TestImageHashVerification-12227837 None] Acquiring lock "cinder-quobyte-db4a0fb7-5219-49e9-b3e6-9958a047e191" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:42:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-03db7a40-cb5f-4365-8455-5b67105e9f73 tempest-TestImageHashVerification-12227837 None] Lock "cinder-quobyte-db4a0fb7-5219-49e9-b3e6-9958a047e191" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:42:05 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e30bb82-4f0b-4f40-a24f-a10273ec0792]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:42:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-03db7a40-cb5f-4365-8455-5b67105e9f73 tempest-TestImageHashVerification-12227837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-db4a0fb7-5219-49e9-b3e6-9958a047e191 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:05 devstack sudo[98346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-db4a0fb7-5219-49e9-b3e6-9958a047e191 Sep 05 11:42:05 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:06 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2d4bb9bd-4048-4ca0-ad95-0c74eee5a2a1" returned: 0 in 0.294s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:42:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:42:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (509eb16d-ca08-4158-a7e3-bb10c79eaf30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d4bb9bd-4048-4ca0-ad95-0c74eee5a2a1', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b53b65d1-e251-4a64-9db7-cbd4d5747c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:06 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Volume volume-2d4bb9bd-4048-4ca0-ad95-0c74eee5a2a1 (2d4bb9bd-4048-4ca0-ad95-0c74eee5a2a1): created successfully Sep 05 11:42:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b53b65d1-e251-4a64-9db7-cbd4d5747c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Flow 'volume_create_manager' (91314815-dce6-4a5c-bfdd-1eccbbb04125) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:42:06 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-17cdeb54-ac86-496a-97a3-6b65f3f214d2 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Created volume successfully. Sep 05 11:42:06 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-03db7a40-cb5f-4365-8455-5b67105e9f73 tempest-TestImageHashVerification-12227837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-db4a0fb7-5219-49e9-b3e6-9958a047e191" returned: 0 in 0.392s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-03db7a40-cb5f-4365-8455-5b67105e9f73 tempest-TestImageHashVerification-12227837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-db4a0fb7-5219-49e9-b3e6-9958a047e191 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:06 devstack sudo[98352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-db4a0fb7-5219-49e9-b3e6-9958a047e191 Sep 05 11:42:06 devstack sudo[98352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b2db302a-edbc-4dfd-84bd-838ec4ed9713 tempest-VolumesGetTest-997413188 None] Acquiring lock "cinder-10d5f59f-8cc1-4b79-b6f7-d51cd4b43a46-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:42:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b2db302a-edbc-4dfd-84bd-838ec4ed9713 tempest-VolumesGetTest-997413188 None] Lock "cinder-10d5f59f-8cc1-4b79-b6f7-d51cd4b43a46-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:42:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b2db302a-edbc-4dfd-84bd-838ec4ed9713 tempest-VolumesGetTest-997413188 None] Acquiring lock "cinder-quobyte-10d5f59f-8cc1-4b79-b6f7-d51cd4b43a46" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:42:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b2db302a-edbc-4dfd-84bd-838ec4ed9713 tempest-VolumesGetTest-997413188 None] Lock "cinder-quobyte-10d5f59f-8cc1-4b79-b6f7-d51cd4b43a46" acquired by "delete_volume" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:42:06 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b952a2f-3e2c-40f9-95fa-1d48801c0ab2]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:42:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b2db302a-edbc-4dfd-84bd-838ec4ed9713 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-10d5f59f-8cc1-4b79-b6f7-d51cd4b43a46 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:06 devstack sudo[98352]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-03db7a40-cb5f-4365-8455-5b67105e9f73 tempest-TestImageHashVerification-12227837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-db4a0fb7-5219-49e9-b3e6-9958a047e191" returned: 0 in 0.264s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:06 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-10d5f59f-8cc1-4b79-b6f7-d51cd4b43a46 Sep 05 11:42:06 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-03db7a40-cb5f-4365-8455-5b67105e9f73 tempest-TestImageHashVerification-12227837 None] Lock "cinder-quobyte-db4a0fb7-5219-49e9-b3e6-9958a047e191" released by "delete_volume" :: held 0.704s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:42:06 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-03db7a40-cb5f-4365-8455-5b67105e9f73 tempest-TestImageHashVerification-12227837 None] Created reservations ['6afb7dfb-0e7a-4174-902f-2542c14826ec', '183e022b-260b-4943-bc8d-9f926bccc80e', '019440cb-76b1-4831-b90c-8fca77b98b67', '4b1e08d6-f099-4402-963b-f6da91d3981a'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:42:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-03db7a40-cb5f-4365-8455-5b67105e9f73 tempest-TestImageHashVerification-12227837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:42:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-03db7a40-cb5f-4365-8455-5b67105e9f73 tempest-TestImageHashVerification-12227837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:42:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-03db7a40-cb5f-4365-8455-5b67105e9f73 tempest-TestImageHashVerification-12227837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:42:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-03db7a40-cb5f-4365-8455-5b67105e9f73 tempest-TestImageHashVerification-12227837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:42:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-03db7a40-cb5f-4365-8455-5b67105e9f73 tempest-TestImageHashVerification-12227837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:42:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-03db7a40-cb5f-4365-8455-5b67105e9f73 tempest-TestImageHashVerification-12227837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:06 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:42:06 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:06 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b2db302a-edbc-4dfd-84bd-838ec4ed9713 tempest-VolumesGetTest-997413188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-10d5f59f-8cc1-4b79-b6f7-d51cd4b43a46" returned: 0 in 0.369s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b2db302a-edbc-4dfd-84bd-838ec4ed9713 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-10d5f59f-8cc1-4b79-b6f7-d51cd4b43a46 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:06 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-10d5f59f-8cc1-4b79-b6f7-d51cd4b43a46 Sep 05 11:42:06 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:06 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-03db7a40-cb5f-4365-8455-5b67105e9f73 tempest-TestImageHashVerification-12227837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.264s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:06 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-03db7a40-cb5f-4365-8455-5b67105e9f73 tempest-TestImageHashVerification-12227837 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:42:06 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-03db7a40-cb5f-4365-8455-5b67105e9f73 tempest-TestImageHashVerification-12227837 None] Deleted volume successfully. Sep 05 11:42:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-03db7a40-cb5f-4365-8455-5b67105e9f73 tempest-TestImageHashVerification-12227837 None] Lock "cinder-db4a0fb7-5219-49e9-b3e6-9958a047e191-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:42:07 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b2db302a-edbc-4dfd-84bd-838ec4ed9713 tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-10d5f59f-8cc1-4b79-b6f7-d51cd4b43a46" returned: 0 in 0.283s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b2db302a-edbc-4dfd-84bd-838ec4ed9713 tempest-VolumesGetTest-997413188 None] Lock "cinder-quobyte-10d5f59f-8cc1-4b79-b6f7-d51cd4b43a46" released by "delete_volume" :: held 0.700s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:42:07 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-b2db302a-edbc-4dfd-84bd-838ec4ed9713 tempest-VolumesGetTest-997413188 None] Created reservations ['ce588283-565e-46be-a601-53ecc653bba8', '21a538d5-e8f1-4947-af6f-d90738d760f0', '5e2ccb2a-9563-4b6d-b584-dc2de827a15f', 'bd885858-ffd5-4698-b133-82ff33dda9d3'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:42:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b2db302a-edbc-4dfd-84bd-838ec4ed9713 tempest-VolumesGetTest-997413188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:42:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b2db302a-edbc-4dfd-84bd-838ec4ed9713 tempest-VolumesGetTest-997413188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:42:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b2db302a-edbc-4dfd-84bd-838ec4ed9713 tempest-VolumesGetTest-997413188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:42:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b2db302a-edbc-4dfd-84bd-838ec4ed9713 tempest-VolumesGetTest-997413188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:42:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b2db302a-edbc-4dfd-84bd-838ec4ed9713 tempest-VolumesGetTest-997413188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:42:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b2db302a-edbc-4dfd-84bd-838ec4ed9713 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:07 devstack sudo[98366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:42:07 devstack sudo[98366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:07 devstack sudo[98366]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d49a0d88-c93f-4d3b-adc0-1040846ad1ab tempest-VolumesGetTest-997413188 None] Acquiring lock "cinder-7c942c94-f1d2-4eae-a5b9-100cefaaa1e1-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:42:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b2db302a-edbc-4dfd-84bd-838ec4ed9713 tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.288s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:07 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-b2db302a-edbc-4dfd-84bd-838ec4ed9713 tempest-VolumesGetTest-997413188 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:42:07 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b2db302a-edbc-4dfd-84bd-838ec4ed9713 tempest-VolumesGetTest-997413188 None] Deleted volume successfully. Sep 05 11:42:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d49a0d88-c93f-4d3b-adc0-1040846ad1ab tempest-VolumesGetTest-997413188 None] Lock "cinder-7c942c94-f1d2-4eae-a5b9-100cefaaa1e1-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:42:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b2db302a-edbc-4dfd-84bd-838ec4ed9713 tempest-VolumesGetTest-997413188 None] Lock "cinder-10d5f59f-8cc1-4b79-b6f7-d51cd4b43a46-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:42:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d49a0d88-c93f-4d3b-adc0-1040846ad1ab tempest-VolumesGetTest-997413188 None] Acquiring lock "cinder-quobyte-7c942c94-f1d2-4eae-a5b9-100cefaaa1e1" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:42:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d49a0d88-c93f-4d3b-adc0-1040846ad1ab tempest-VolumesGetTest-997413188 None] Lock "cinder-quobyte-7c942c94-f1d2-4eae-a5b9-100cefaaa1e1" acquired by "delete_volume" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:42:07 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f984c3c-f89b-409e-a8a5-9902d2f33f84]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:42:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d49a0d88-c93f-4d3b-adc0-1040846ad1ab tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7c942c94-f1d2-4eae-a5b9-100cefaaa1e1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:07 devstack sudo[98369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7c942c94-f1d2-4eae-a5b9-100cefaaa1e1 Sep 05 11:42:07 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:08 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d49a0d88-c93f-4d3b-adc0-1040846ad1ab tempest-VolumesGetTest-997413188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7c942c94-f1d2-4eae-a5b9-100cefaaa1e1" returned: 0 in 0.438s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d49a0d88-c93f-4d3b-adc0-1040846ad1ab tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7c942c94-f1d2-4eae-a5b9-100cefaaa1e1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:08 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7c942c94-f1d2-4eae-a5b9-100cefaaa1e1 Sep 05 11:42:08 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a395015f-020b-418b-b670-728c1a8c01b0 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Acquiring lock "cinder-2d4bb9bd-4048-4ca0-ad95-0c74eee5a2a1-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:42:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a395015f-020b-418b-b670-728c1a8c01b0 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Lock "cinder-2d4bb9bd-4048-4ca0-ad95-0c74eee5a2a1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:42:08 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d49a0d88-c93f-4d3b-adc0-1040846ad1ab tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7c942c94-f1d2-4eae-a5b9-100cefaaa1e1" returned: 0 in 0.340s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d49a0d88-c93f-4d3b-adc0-1040846ad1ab tempest-VolumesGetTest-997413188 None] Lock "cinder-quobyte-7c942c94-f1d2-4eae-a5b9-100cefaaa1e1" released by "delete_volume" :: held 0.841s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:42:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a395015f-020b-418b-b670-728c1a8c01b0 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Acquiring lock "cinder-quobyte-2d4bb9bd-4048-4ca0-ad95-0c74eee5a2a1" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:42:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a395015f-020b-418b-b670-728c1a8c01b0 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Lock "cinder-quobyte-2d4bb9bd-4048-4ca0-ad95-0c74eee5a2a1" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:42:08 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9142452-91f7-470f-81a5-7b88c6cc4617]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:42:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a395015f-020b-418b-b670-728c1a8c01b0 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2d4bb9bd-4048-4ca0-ad95-0c74eee5a2a1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:08 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-d49a0d88-c93f-4d3b-adc0-1040846ad1ab tempest-VolumesGetTest-997413188 None] Created reservations ['e9c32182-c4a7-41f3-bed1-755614d82dde', '09ed8833-0f1e-430b-af98-7b0d58646d10', '328f2676-26fa-479d-b3c7-f8bf145c5a81', 'e708f419-f27d-4ec3-b0d6-d15034feece6'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:42:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d49a0d88-c93f-4d3b-adc0-1040846ad1ab tempest-VolumesGetTest-997413188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:42:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d49a0d88-c93f-4d3b-adc0-1040846ad1ab tempest-VolumesGetTest-997413188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:42:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d49a0d88-c93f-4d3b-adc0-1040846ad1ab tempest-VolumesGetTest-997413188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:42:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d49a0d88-c93f-4d3b-adc0-1040846ad1ab tempest-VolumesGetTest-997413188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:42:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d49a0d88-c93f-4d3b-adc0-1040846ad1ab tempest-VolumesGetTest-997413188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:42:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d49a0d88-c93f-4d3b-adc0-1040846ad1ab tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:08 devstack sudo[98377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2d4bb9bd-4048-4ca0-ad95-0c74eee5a2a1 Sep 05 11:42:08 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:08 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:42:08 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-901c3891-7edd-43e7-8b75-396628e64387 tempest-VolumesGetTest-997413188 None] Acquiring lock "cinder-3d2dbb52-8180-49cf-91f8-f5ff476db1da-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:42:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-901c3891-7edd-43e7-8b75-396628e64387 tempest-VolumesGetTest-997413188 None] Lock "cinder-3d2dbb52-8180-49cf-91f8-f5ff476db1da-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:42:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-901c3891-7edd-43e7-8b75-396628e64387 tempest-VolumesGetTest-997413188 None] Acquiring lock "cinder-quobyte-3d2dbb52-8180-49cf-91f8-f5ff476db1da" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:42:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-901c3891-7edd-43e7-8b75-396628e64387 tempest-VolumesGetTest-997413188 None] Lock "cinder-quobyte-3d2dbb52-8180-49cf-91f8-f5ff476db1da" acquired by "delete_volume" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:42:09 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a395015f-020b-418b-b670-728c1a8c01b0 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2d4bb9bd-4048-4ca0-ad95-0c74eee5a2a1" returned: 0 in 0.467s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a395015f-020b-418b-b670-728c1a8c01b0 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2d4bb9bd-4048-4ca0-ad95-0c74eee5a2a1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:09 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b363277-c054-489e-8424-b8804ef6d51b]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:42:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-901c3891-7edd-43e7-8b75-396628e64387 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:09 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2d4bb9bd-4048-4ca0-ad95-0c74eee5a2a1 Sep 05 11:42:09 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:09 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d49a0d88-c93f-4d3b-adc0-1040846ad1ab tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.419s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:09 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-d49a0d88-c93f-4d3b-adc0-1040846ad1ab tempest-VolumesGetTest-997413188 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:42:09 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d49a0d88-c93f-4d3b-adc0-1040846ad1ab tempest-VolumesGetTest-997413188 None] Deleted volume successfully. Sep 05 11:42:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d49a0d88-c93f-4d3b-adc0-1040846ad1ab tempest-VolumesGetTest-997413188 None] Lock "cinder-7c942c94-f1d2-4eae-a5b9-100cefaaa1e1-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:42:09 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da Sep 05 11:42:09 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:09 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a395015f-020b-418b-b670-728c1a8c01b0 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2d4bb9bd-4048-4ca0-ad95-0c74eee5a2a1" returned: 0 in 0.349s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a395015f-020b-418b-b670-728c1a8c01b0 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Lock "cinder-quobyte-2d4bb9bd-4048-4ca0-ad95-0c74eee5a2a1" released by "delete_volume" :: held 0.863s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:42:09 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-a395015f-020b-418b-b670-728c1a8c01b0 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Created reservations ['f8abe9eb-3ae7-4227-8f0b-1fd24d9da963', 'c393549e-60ad-42e7-a300-e1006883bb7f', '613ab8fe-6099-46f9-8d2c-c78c60694a37', 'b486e165-9af4-470a-be8a-5509777b74cb'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:42:09 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-901c3891-7edd-43e7-8b75-396628e64387 tempest-VolumesGetTest-997413188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da" returned: 0 in 0.463s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-901c3891-7edd-43e7-8b75-396628e64387 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:09 devstack sudo[98395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da Sep 05 11:42:09 devstack sudo[98395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a395015f-020b-418b-b670-728c1a8c01b0 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:42:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a395015f-020b-418b-b670-728c1a8c01b0 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:42:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a395015f-020b-418b-b670-728c1a8c01b0 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:42:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a395015f-020b-418b-b670-728c1a8c01b0 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:42:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a395015f-020b-418b-b670-728c1a8c01b0 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:42:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a395015f-020b-418b-b670-728c1a8c01b0 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:09 devstack sudo[98397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:42:09 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:09 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a395015f-020b-418b-b670-728c1a8c01b0 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.323s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:09 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-a395015f-020b-418b-b670-728c1a8c01b0 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:42:09 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a395015f-020b-418b-b670-728c1a8c01b0 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Deleted volume successfully. Sep 05 11:42:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a395015f-020b-418b-b670-728c1a8c01b0 tempest-VolumeQuotasNegativeTestJSON-1452108754 None] Lock "cinder-2d4bb9bd-4048-4ca0-ad95-0c74eee5a2a1-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:42:10 devstack sudo[98395]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-901c3891-7edd-43e7-8b75-396628e64387 tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3d2dbb52-8180-49cf-91f8-f5ff476db1da" returned: 0 in 0.509s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-901c3891-7edd-43e7-8b75-396628e64387 tempest-VolumesGetTest-997413188 None] Lock "cinder-quobyte-3d2dbb52-8180-49cf-91f8-f5ff476db1da" released by "delete_volume" :: held 1.070s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:42:10 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-901c3891-7edd-43e7-8b75-396628e64387 tempest-VolumesGetTest-997413188 None] Created reservations ['9093eda3-4fee-42b7-a3ee-a085af0f5876', 'de5efa52-1e88-44ab-876e-7e40623c5daf', '793b3e6a-2405-4412-9497-7f2d47bb6648', '6ab42595-1ea0-4e97-80d2-71531ca221c4'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:42:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-901c3891-7edd-43e7-8b75-396628e64387 tempest-VolumesGetTest-997413188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:42:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-901c3891-7edd-43e7-8b75-396628e64387 tempest-VolumesGetTest-997413188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:42:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-901c3891-7edd-43e7-8b75-396628e64387 tempest-VolumesGetTest-997413188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:42:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-901c3891-7edd-43e7-8b75-396628e64387 tempest-VolumesGetTest-997413188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:42:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-901c3891-7edd-43e7-8b75-396628e64387 tempest-VolumesGetTest-997413188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:42:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-901c3891-7edd-43e7-8b75-396628e64387 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:10 devstack sudo[98401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:42:10 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:10 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-901c3891-7edd-43e7-8b75-396628e64387 tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.289s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:10 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-901c3891-7edd-43e7-8b75-396628e64387 tempest-VolumesGetTest-997413188 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:42:10 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-901c3891-7edd-43e7-8b75-396628e64387 tempest-VolumesGetTest-997413188 None] Deleted volume successfully. Sep 05 11:42:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-901c3891-7edd-43e7-8b75-396628e64387 tempest-VolumesGetTest-997413188 None] Lock "cinder-3d2dbb52-8180-49cf-91f8-f5ff476db1da-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:42:12 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:42:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Flow 'volume_create_manager' (a3ff6c3e-ed0d-4cce-837b-f5cb55a68807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:42:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcd79a62-d46b-457b-be88-bf81d7e5fe93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcd79a62-d46b-457b-be88-bf81d7e5fe93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1765645819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53cfd149-7a8b-4fae-b29d-e4923df37c42,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c1fe7e365b1d48b2b9580f4796bbea42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:42:12Z,use_quota=True,user_id='d467b9677fb64570a0d79e0680ac33d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (914856a9-3398-4d77-a500-773d9c434fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (914856a9-3398-4d77-a500-773d9c434fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4903b5f-fb6b-4c60-b3fa-a27cd00a714d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:12 devstack cinder-volume[87517]: DEBUG cinder.image.glance [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Creating Keystone auth plugin from conf {{(pid=87517) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 11:42:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4903b5f-fb6b-4c60-b3fa-a27cd00a714d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '53cfd149-7a8b-4fae-b29d-e4923df37c42', 'volume_name': 'volume-53cfd149-7a8b-4fae-b29d-e4923df37c42', 'volume_size': 1, 'image_id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c73a992b4ff1451ca3178925081bf687', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'created_at': datetime.datetime(2026, 9, 5, 9, 26, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 9, 26, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18178db3-a2f2-47f0-9a47-326ff4246066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18178db3-a2f2-47f0-9a47-326ff4246066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52741779-afe9-4f56-a67f-651a4641b66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:12 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Volume 53cfd149-7a8b-4fae-b29d-e4923df37c42: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-53cfd149-7a8b-4fae-b29d-e4923df37c42', 'volume_size': 1, 'image_id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c73a992b4ff1451ca3178925081bf687', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'created_at': datetime.datetime(2026, 9, 5, 9, 26, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 9, 26, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 05 11:42:12 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Trying to clone 53cfd149-7a8b-4fae-b29d-e4923df37c42 from image fff52cc1-bd64-4eb0-8735-62bad8dd7741 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'metadata': {}}]). {{(pid=87517) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 11:42:13 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_72xn7x7gdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 11:42:13 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Image download 20.69 MB at 20.69 MB/s Sep 05 11:42:13 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ba6fb1-755d-469e-a2b3-149ddd3dfd5f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:42:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_72xn7x7gdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:13 devstack sudo[98409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_72xn7x7gdevstack@QuobyteHD Sep 05 11:42:13 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:13 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_72xn7x7gdevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:13 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Temporary image fff52cc1-bd64-4eb0-8735-62bad8dd7741 is fetched for user d467b9677fb64570a0d79e0680ac33d4. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 11:42:13 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8c78e6-9a82-4715-958d-f1bc04e0fec4]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:42:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_72xn7x7gdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:13 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_72xn7x7gdevstack@QuobyteHD Sep 05 11:42:13 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:14 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_72xn7x7gdevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:42:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:42:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1765645819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53cfd149-7a8b-4fae-b29d-e4923df37c42,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c1fe7e365b1d48b2b9580f4796bbea42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:42:12Z,use_quota=True,user_id='d467b9677fb64570a0d79e0680ac33d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:42:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Creating volume 53cfd149-7a8b-4fae-b29d-e4923df37c42 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:42:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:42:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:42:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:42:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:42:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:42:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:42:14 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:42:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-53cfd149-7a8b-4fae-b29d-e4923df37c42 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:14 devstack sudo[98419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-53cfd149-7a8b-4fae-b29d-e4923df37c42 1073741824 Sep 05 11:42:14 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:14 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-53cfd149-7a8b-4fae-b29d-e4923df37c42 1073741824" returned: 0 in 0.471s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-53cfd149-7a8b-4fae-b29d-e4923df37c42 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:14 devstack sudo[98425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-53cfd149-7a8b-4fae-b29d-e4923df37c42 Sep 05 11:42:14 devstack sudo[98425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:14 devstack sudo[98425]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-53cfd149-7a8b-4fae-b29d-e4923df37c42" returned: 0 in 0.313s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:42:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:42:14 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Attempting download of fff52cc1-bd64-4eb0-8735-62bad8dd7741 ((None, [{'url': 'file:///opt/stack/data/glance/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'metadata': {}}])) to volume 53cfd149-7a8b-4fae-b29d-e4923df37c42. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 11:42:15 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe07ff40-9d40-42e8-b86c-6b175d3afcd2]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:42:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741_w6945qyh {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:15 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741_w6945qyh Sep 05 11:42:15 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:15 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741_w6945qyh" returned: 0 in 0.421s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741_w6945qyh {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:15 devstack sudo[98433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741_w6945qyh Sep 05 11:42:15 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:15 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741_w6945qyh" returned: 1 in 0.355s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fff52cc1-bd64-4eb0-8735-62bad8dd7741_w6945qyh' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 11:42:15 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc90a716-13a8-4ea5-8228-de46ea52202b]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:42:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_72xn7x7gdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:15 devstack sudo[98437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_72xn7x7gdevstack@QuobyteHD Sep 05 11:42:15 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:16 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_72xn7x7gdevstack@QuobyteHD" returned: 0 in 0.481s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:16 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] fff52cc1-bd64-4eb0-8735-62bad8dd7741 was qcow2, converting to qcow2 {{(pid=87517) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 11:42:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_72xn7x7gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-53cfd149-7a8b-4fae-b29d-e4923df37c42 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:16 devstack sudo[98442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_72xn7x7gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-53cfd149-7a8b-4fae-b29d-e4923df37c42 Sep 05 11:42:16 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:18 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_72xn7x7gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-53cfd149-7a8b-4fae-b29d-e4923df37c42" returned: 0 in 2.325s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:18 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fff52cc1-bd64-4eb0-8735-62bad8dd7741_72xn7x7gdevstack@QuobyteHD, size 112.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-53cfd149-7a8b-4fae-b29d-e4923df37c42 {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 11:42:18 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Converted 112.00 MB image at 48.14 MB/s Sep 05 11:42:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-53cfd149-7a8b-4fae-b29d-e4923df37c42 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:18 devstack sudo[98452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-53cfd149-7a8b-4fae-b29d-e4923df37c42 1G Sep 05 11:42:18 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:18 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-53cfd149-7a8b-4fae-b29d-e4923df37c42 1G" returned: 0 in 0.364s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:18 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Downloaded image fff52cc1-bd64-4eb0-8735-62bad8dd7741 ((None, [{'url': 'file:///opt/stack/data/glance/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'metadata': {}}])) to volume 53cfd149-7a8b-4fae-b29d-e4923df37c42 successfully. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 11:42:18 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Temporary image fff52cc1-bd64-4eb0-8735-62bad8dd7741 for user d467b9677fb64570a0d79e0680ac33d4 is deleted. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 11:42:18 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Marking volume 53cfd149-7a8b-4fae-b29d-e4923df37c42 as bootable. {{(pid=87517) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 11:42:19 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Copying metadata from image fff52cc1-bd64-4eb0-8735-62bad8dd7741 to 53cfd149-7a8b-4fae-b29d-e4923df37c42. {{(pid=87517) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 11:42:19 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Creating volume glance metadata for volume 53cfd149-7a8b-4fae-b29d-e4923df37c42 backed by image fff52cc1-bd64-4eb0-8735-62bad8dd7741 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87517) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 11:42:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52741779-afe9-4f56-a67f-651a4641b66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53cfd149-7a8b-4fae-b29d-e4923df37c42', 'volume_size': 1, 'image_id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c73a992b4ff1451ca3178925081bf687', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fff52cc1-bd64-4eb0-8735-62bad8dd7741', 'created_at': datetime.datetime(2026, 9, 5, 9, 26, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 9, 26, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fff52cc1-bd64-4eb0-8735-62bad8dd7741/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab9c768-25af-45a2-9811-26a5c77ea13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:19 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Volume volume-53cfd149-7a8b-4fae-b29d-e4923df37c42 (53cfd149-7a8b-4fae-b29d-e4923df37c42): created successfully Sep 05 11:42:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab9c768-25af-45a2-9811-26a5c77ea13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Flow 'volume_create_manager' (a3ff6c3e-ed0d-4cce-837b-f5cb55a68807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:42:19 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-865c9ba3-b310-422e-b23a-49b33547fb90 tempest-VolumesGetTest-997413188 None] Created volume successfully. Sep 05 11:42:20 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:42:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] Flow 'volume_create_manager' (4f5e1131-d1b7-42a4-ab61-69380b5b509f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:42:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de6190b-9c3c-4791-9062-968bdcdb41fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de6190b-9c3c-4791-9062-968bdcdb41fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:42:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1235175591',display_name='tempest-VolumesGetTest-Volume-1358375391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cfc3b6c-9012-429a-8088-c8b1793ba775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1fe7e365b1d48b2b9580f4796bbea42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:42:20Z,use_quota=True,user_id='d467b9677fb64570a0d79e0680ac33d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f697e0-0c3a-4ab7-958f-422acc592004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f697e0-0c3a-4ab7-958f-422acc592004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4bd73b2-e935-4bc1-b884-9319857d8a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4bd73b2-e935-4bc1-b884-9319857d8a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cfc3b6c-9012-429a-8088-c8b1793ba775', 'volume_name': 'volume-4cfc3b6c-9012-429a-8088-c8b1793ba775', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb7adf14-0818-4a5a-a77a-0e102cd31ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb7adf14-0818-4a5a-a77a-0e102cd31ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:20 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c948db35-d63c-4535-aaf5-b1311e2e4a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:20 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] Volume 4cfc3b6c-9012-429a-8088-c8b1793ba775: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cfc3b6c-9012-429a-8088-c8b1793ba775', 'volume_size': 1} Sep 05 11:42:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:42:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:42:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:42:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1235175591',display_name='tempest-VolumesGetTest-Volume-1358375391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cfc3b6c-9012-429a-8088-c8b1793ba775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1fe7e365b1d48b2b9580f4796bbea42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:42:20Z,use_quota=True,user_id='d467b9677fb64570a0d79e0680ac33d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:42:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] Creating volume 4cfc3b6c-9012-429a-8088-c8b1793ba775 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:42:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:42:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:42:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:42:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:42:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:42:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:42:20 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:42:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4cfc3b6c-9012-429a-8088-c8b1793ba775 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:20 devstack sudo[98458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4cfc3b6c-9012-429a-8088-c8b1793ba775 1073741824 Sep 05 11:42:20 devstack sudo[98458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:21 devstack sudo[98458]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4cfc3b6c-9012-429a-8088-c8b1793ba775 1073741824" returned: 0 in 0.521s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4cfc3b6c-9012-429a-8088-c8b1793ba775 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:21 devstack sudo[98464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4cfc3b6c-9012-429a-8088-c8b1793ba775 Sep 05 11:42:21 devstack sudo[98464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:21 devstack sudo[98464]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4cfc3b6c-9012-429a-8088-c8b1793ba775" returned: 0 in 0.293s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:42:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:42:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c948db35-d63c-4535-aaf5-b1311e2e4a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cfc3b6c-9012-429a-8088-c8b1793ba775', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (506c3d40-6af2-4ce1-8587-bf75e4468739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:21 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] Volume volume-4cfc3b6c-9012-429a-8088-c8b1793ba775 (4cfc3b6c-9012-429a-8088-c8b1793ba775): created successfully Sep 05 11:42:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (506c3d40-6af2-4ce1-8587-bf75e4468739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] Flow 'volume_create_manager' (4f5e1131-d1b7-42a4-ab61-69380b5b509f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:42:21 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f2bb216c-0fda-48be-a661-8d5274aba969 tempest-VolumesGetTest-997413188 None] Created volume successfully. Sep 05 11:42:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d496719-aafe-4bd1-90c2-6a4b81ff15aa tempest-VolumesGetTest-997413188 None] Acquiring lock "cinder-4cfc3b6c-9012-429a-8088-c8b1793ba775-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:42:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d496719-aafe-4bd1-90c2-6a4b81ff15aa tempest-VolumesGetTest-997413188 None] Lock "cinder-4cfc3b6c-9012-429a-8088-c8b1793ba775-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:42:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d496719-aafe-4bd1-90c2-6a4b81ff15aa tempest-VolumesGetTest-997413188 None] Acquiring lock "cinder-quobyte-4cfc3b6c-9012-429a-8088-c8b1793ba775" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:42:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d496719-aafe-4bd1-90c2-6a4b81ff15aa tempest-VolumesGetTest-997413188 None] Lock "cinder-quobyte-4cfc3b6c-9012-429a-8088-c8b1793ba775" acquired by "delete_volume" :: waited 0.024s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:42:22 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e3f813-d4a9-4bc2-9e30-b8ad113f029a]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d496719-aafe-4bd1-90c2-6a4b81ff15aa tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4cfc3b6c-9012-429a-8088-c8b1793ba775 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] Flow 'volume_create_manager' (4f689340-5e67-4173-84ea-2957fbc8928d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aae6805-d9d6-4acc-ab81-48af3b6873c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aae6805-d9d6-4acc-ab81-48af3b6873c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-987118435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eae4cf08-1685-4e9a-845b-b071d48c5366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91943246882646739a2b1f29daa460fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:42:23Z,use_quota=True,user_id='bdecb7ede07b491696f724370592d78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca25722c-3d14-4b78-aaf0-05cfab00582c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca25722c-3d14-4b78-aaf0-05cfab00582c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (291789de-12a6-4729-bf5f-76ce32933af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (291789de-12a6-4729-bf5f-76ce32933af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eae4cf08-1685-4e9a-845b-b071d48c5366', 'volume_name': 'volume-eae4cf08-1685-4e9a-845b-b071d48c5366', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:23 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4cfc3b6c-9012-429a-8088-c8b1793ba775 Sep 05 11:42:23 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c24f70-1efb-404d-835c-5d7e14a4e265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c24f70-1efb-404d-835c-5d7e14a4e265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2640151-5585-496e-8e64-fa8fbda22613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:23 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] Volume eae4cf08-1685-4e9a-845b-b071d48c5366: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eae4cf08-1685-4e9a-845b-b071d48c5366', 'volume_size': 1} Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-987118435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eae4cf08-1685-4e9a-845b-b071d48c5366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91943246882646739a2b1f29daa460fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:42:23Z,use_quota=True,user_id='bdecb7ede07b491696f724370592d78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] Creating volume eae4cf08-1685-4e9a-845b-b071d48c5366 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:42:23 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eae4cf08-1685-4e9a-845b-b071d48c5366 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:23 devstack sudo[98471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eae4cf08-1685-4e9a-845b-b071d48c5366 1073741824 Sep 05 11:42:23 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:23 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d496719-aafe-4bd1-90c2-6a4b81ff15aa tempest-VolumesGetTest-997413188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4cfc3b6c-9012-429a-8088-c8b1793ba775" returned: 0 in 0.443s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d496719-aafe-4bd1-90c2-6a4b81ff15aa tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4cfc3b6c-9012-429a-8088-c8b1793ba775 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:23 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4cfc3b6c-9012-429a-8088-c8b1793ba775 Sep 05 11:42:23 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:23 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eae4cf08-1685-4e9a-845b-b071d48c5366 1073741824" returned: 0 in 0.511s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:23 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d496719-aafe-4bd1-90c2-6a4b81ff15aa tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4cfc3b6c-9012-429a-8088-c8b1793ba775" returned: 0 in 0.280s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d496719-aafe-4bd1-90c2-6a4b81ff15aa tempest-VolumesGetTest-997413188 None] Lock "cinder-quobyte-4cfc3b6c-9012-429a-8088-c8b1793ba775" released by "delete_volume" :: held 0.781s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eae4cf08-1685-4e9a-845b-b071d48c5366 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:23 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eae4cf08-1685-4e9a-845b-b071d48c5366 Sep 05 11:42:23 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-1d496719-aafe-4bd1-90c2-6a4b81ff15aa tempest-VolumesGetTest-997413188 None] Created reservations ['254e934a-7545-480f-b93f-367a690bacc3', '72fb02a9-7210-452b-a5d0-88fc0f461576', 'b5f9b65d-1b08-41bc-9684-c74a365e2e6d', 'e2369c68-c7b9-4305-b41c-653523b55283'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1d496719-aafe-4bd1-90c2-6a4b81ff15aa tempest-VolumesGetTest-997413188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1d496719-aafe-4bd1-90c2-6a4b81ff15aa tempest-VolumesGetTest-997413188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1d496719-aafe-4bd1-90c2-6a4b81ff15aa tempest-VolumesGetTest-997413188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1d496719-aafe-4bd1-90c2-6a4b81ff15aa tempest-VolumesGetTest-997413188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1d496719-aafe-4bd1-90c2-6a4b81ff15aa tempest-VolumesGetTest-997413188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:42:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d496719-aafe-4bd1-90c2-6a4b81ff15aa tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:23 devstack sudo[98484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:42:23 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:24 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eae4cf08-1685-4e9a-845b-b071d48c5366" returned: 0 in 0.285s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:42:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:42:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2640151-5585-496e-8e64-fa8fbda22613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eae4cf08-1685-4e9a-845b-b071d48c5366', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2eb18d6-4dac-4c0f-a572-82ae585384da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:24 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] Volume volume-eae4cf08-1685-4e9a-845b-b071d48c5366 (eae4cf08-1685-4e9a-845b-b071d48c5366): created successfully Sep 05 11:42:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2eb18d6-4dac-4c0f-a572-82ae585384da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] Flow 'volume_create_manager' (4f689340-5e67-4173-84ea-2957fbc8928d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:42:24 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7966d833-59e1-4bc9-b44e-57d7450d8e78 tempest-ProjectReaderTests-1241197718 None] Created volume successfully. Sep 05 11:42:24 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e58e820c-7874-4dfd-a314-cc1c62b5a54c tempest-VolumesGetTest-997413188 None] Acquiring lock "cinder-53cfd149-7a8b-4fae-b29d-e4923df37c42-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:42:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d496719-aafe-4bd1-90c2-6a4b81ff15aa tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.321s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:24 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-1d496719-aafe-4bd1-90c2-6a4b81ff15aa tempest-VolumesGetTest-997413188 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:42:24 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-1d496719-aafe-4bd1-90c2-6a4b81ff15aa tempest-VolumesGetTest-997413188 None] Deleted volume successfully. Sep 05 11:42:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e58e820c-7874-4dfd-a314-cc1c62b5a54c tempest-VolumesGetTest-997413188 None] Lock "cinder-53cfd149-7a8b-4fae-b29d-e4923df37c42-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:42:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1d496719-aafe-4bd1-90c2-6a4b81ff15aa tempest-VolumesGetTest-997413188 None] Lock "cinder-4cfc3b6c-9012-429a-8088-c8b1793ba775-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:42:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e58e820c-7874-4dfd-a314-cc1c62b5a54c tempest-VolumesGetTest-997413188 None] Acquiring lock "cinder-quobyte-53cfd149-7a8b-4fae-b29d-e4923df37c42" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:42:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e58e820c-7874-4dfd-a314-cc1c62b5a54c tempest-VolumesGetTest-997413188 None] Lock "cinder-quobyte-53cfd149-7a8b-4fae-b29d-e4923df37c42" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:42:24 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29d2066-caaf-48fd-be0d-ea779ad58810]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:42:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e58e820c-7874-4dfd-a314-cc1c62b5a54c tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-53cfd149-7a8b-4fae-b29d-e4923df37c42 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:24 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-53cfd149-7a8b-4fae-b29d-e4923df37c42 Sep 05 11:42:24 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:24 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e58e820c-7874-4dfd-a314-cc1c62b5a54c tempest-VolumesGetTest-997413188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-53cfd149-7a8b-4fae-b29d-e4923df37c42" returned: 0 in 0.382s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e58e820c-7874-4dfd-a314-cc1c62b5a54c tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-53cfd149-7a8b-4fae-b29d-e4923df37c42 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:24 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-53cfd149-7a8b-4fae-b29d-e4923df37c42 Sep 05 11:42:24 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:24 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e58e820c-7874-4dfd-a314-cc1c62b5a54c tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-53cfd149-7a8b-4fae-b29d-e4923df37c42" returned: 0 in 0.255s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e58e820c-7874-4dfd-a314-cc1c62b5a54c tempest-VolumesGetTest-997413188 None] Lock "cinder-quobyte-53cfd149-7a8b-4fae-b29d-e4923df37c42" released by "delete_volume" :: held 0.690s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:42:25 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-e58e820c-7874-4dfd-a314-cc1c62b5a54c tempest-VolumesGetTest-997413188 None] Created reservations ['d70ecb9a-6f21-4d67-a07f-13f576fb6a78', 'db1c174e-203c-4af1-a048-c8e8b7301740', '8f27f18c-8ea6-4bdc-9a64-3e5725df59e6', 'f8d5b4b5-bc03-406e-a658-05da31124752'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:42:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e58e820c-7874-4dfd-a314-cc1c62b5a54c tempest-VolumesGetTest-997413188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:42:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e58e820c-7874-4dfd-a314-cc1c62b5a54c tempest-VolumesGetTest-997413188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:42:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e58e820c-7874-4dfd-a314-cc1c62b5a54c tempest-VolumesGetTest-997413188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:42:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e58e820c-7874-4dfd-a314-cc1c62b5a54c tempest-VolumesGetTest-997413188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:42:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e58e820c-7874-4dfd-a314-cc1c62b5a54c tempest-VolumesGetTest-997413188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:42:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e58e820c-7874-4dfd-a314-cc1c62b5a54c tempest-VolumesGetTest-997413188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:25 devstack sudo[98498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:42:25 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c1851e19-0fc1-420c-b203-d6eab4b41d39 tempest-ProjectReaderTests-1241197718 None] Acquiring lock "cinder-eae4cf08-1685-4e9a-845b-b071d48c5366-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:42:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c1851e19-0fc1-420c-b203-d6eab4b41d39 tempest-ProjectReaderTests-1241197718 None] Lock "cinder-eae4cf08-1685-4e9a-845b-b071d48c5366-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:42:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c1851e19-0fc1-420c-b203-d6eab4b41d39 tempest-ProjectReaderTests-1241197718 None] Acquiring lock "cinder-quobyte-eae4cf08-1685-4e9a-845b-b071d48c5366" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:42:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c1851e19-0fc1-420c-b203-d6eab4b41d39 tempest-ProjectReaderTests-1241197718 None] Lock "cinder-quobyte-eae4cf08-1685-4e9a-845b-b071d48c5366" acquired by "delete_volume" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:42:25 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc09e74-37e2-4383-820d-f722634f6360]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:42:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c1851e19-0fc1-420c-b203-d6eab4b41d39 tempest-ProjectReaderTests-1241197718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eae4cf08-1685-4e9a-845b-b071d48c5366 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:25 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e58e820c-7874-4dfd-a314-cc1c62b5a54c tempest-VolumesGetTest-997413188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.361s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:25 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-e58e820c-7874-4dfd-a314-cc1c62b5a54c tempest-VolumesGetTest-997413188 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:42:25 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e58e820c-7874-4dfd-a314-cc1c62b5a54c tempest-VolumesGetTest-997413188 None] Deleted volume successfully. Sep 05 11:42:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e58e820c-7874-4dfd-a314-cc1c62b5a54c tempest-VolumesGetTest-997413188 None] Lock "cinder-53cfd149-7a8b-4fae-b29d-e4923df37c42-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:42:25 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eae4cf08-1685-4e9a-845b-b071d48c5366 Sep 05 11:42:25 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:25 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c1851e19-0fc1-420c-b203-d6eab4b41d39 tempest-ProjectReaderTests-1241197718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eae4cf08-1685-4e9a-845b-b071d48c5366" returned: 0 in 0.448s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c1851e19-0fc1-420c-b203-d6eab4b41d39 tempest-ProjectReaderTests-1241197718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eae4cf08-1685-4e9a-845b-b071d48c5366 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:25 devstack sudo[98506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eae4cf08-1685-4e9a-845b-b071d48c5366 Sep 05 11:42:25 devstack sudo[98506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:26 devstack sudo[98506]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c1851e19-0fc1-420c-b203-d6eab4b41d39 tempest-ProjectReaderTests-1241197718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eae4cf08-1685-4e9a-845b-b071d48c5366" returned: 0 in 0.314s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c1851e19-0fc1-420c-b203-d6eab4b41d39 tempest-ProjectReaderTests-1241197718 None] Lock "cinder-quobyte-eae4cf08-1685-4e9a-845b-b071d48c5366" released by "delete_volume" :: held 0.832s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:42:26 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-c1851e19-0fc1-420c-b203-d6eab4b41d39 tempest-ProjectReaderTests-1241197718 None] Created reservations ['94dfcdc4-6f2d-46b8-8b38-70fd978234d2', '51a53042-1283-4da3-aa06-d9c1c8b9a386', 'f311f407-7b45-4e41-a973-cedbea84faa6', '14fad66b-e67b-44d2-9962-c3fc2ff3d390'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:42:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c1851e19-0fc1-420c-b203-d6eab4b41d39 tempest-ProjectReaderTests-1241197718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:42:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c1851e19-0fc1-420c-b203-d6eab4b41d39 tempest-ProjectReaderTests-1241197718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:42:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c1851e19-0fc1-420c-b203-d6eab4b41d39 tempest-ProjectReaderTests-1241197718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:42:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c1851e19-0fc1-420c-b203-d6eab4b41d39 tempest-ProjectReaderTests-1241197718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:42:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c1851e19-0fc1-420c-b203-d6eab4b41d39 tempest-ProjectReaderTests-1241197718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:42:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c1851e19-0fc1-420c-b203-d6eab4b41d39 tempest-ProjectReaderTests-1241197718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:26 devstack sudo[98509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:42:26 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:26 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c1851e19-0fc1-420c-b203-d6eab4b41d39 tempest-ProjectReaderTests-1241197718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.387s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:26 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-c1851e19-0fc1-420c-b203-d6eab4b41d39 tempest-ProjectReaderTests-1241197718 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:42:26 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c1851e19-0fc1-420c-b203-d6eab4b41d39 tempest-ProjectReaderTests-1241197718 None] Deleted volume successfully. Sep 05 11:42:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c1851e19-0fc1-420c-b203-d6eab4b41d39 tempest-ProjectReaderTests-1241197718 None] Lock "cinder-eae4cf08-1685-4e9a-845b-b071d48c5366-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:42:27 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:42:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] Flow 'volume_create_manager' (31421ff5-f6fb-47ac-be98-5428514da098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:42:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c909e2-40d6-463e-84ee-43f8f7b96c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c909e2-40d6-463e-84ee-43f8f7b96c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-150984947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5de6f10b-ab19-46a0-a1d7-215136442652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91943246882646739a2b1f29daa460fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:42:27Z,use_quota=True,user_id='bdecb7ede07b491696f724370592d78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9915b826-5d6d-428c-9ab8-f5120d0d7290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9915b826-5d6d-428c-9ab8-f5120d0d7290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38235086-6d40-4cd7-8298-a2a9345223d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38235086-6d40-4cd7-8298-a2a9345223d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5de6f10b-ab19-46a0-a1d7-215136442652', 'volume_name': 'volume-5de6f10b-ab19-46a0-a1d7-215136442652', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de83ba9-261b-40a0-9f7a-5d83cdfc66ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de83ba9-261b-40a0-9f7a-5d83cdfc66ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaaf1a21-cad7-4857-8714-c6e0fe46aca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:27 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] Volume 5de6f10b-ab19-46a0-a1d7-215136442652: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5de6f10b-ab19-46a0-a1d7-215136442652', 'volume_size': 1} Sep 05 11:42:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:42:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:42:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-150984947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5de6f10b-ab19-46a0-a1d7-215136442652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91943246882646739a2b1f29daa460fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:42:27Z,use_quota=True,user_id='bdecb7ede07b491696f724370592d78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:42:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] Creating volume 5de6f10b-ab19-46a0-a1d7-215136442652 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:42:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:42:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:42:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:42:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:42:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:42:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:42:27 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:42:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5de6f10b-ab19-46a0-a1d7-215136442652 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:27 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5de6f10b-ab19-46a0-a1d7-215136442652 1073741824 Sep 05 11:42:27 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:27 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5de6f10b-ab19-46a0-a1d7-215136442652 1073741824" returned: 0 in 0.555s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5de6f10b-ab19-46a0-a1d7-215136442652 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:27 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5de6f10b-ab19-46a0-a1d7-215136442652 Sep 05 11:42:27 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:28 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5de6f10b-ab19-46a0-a1d7-215136442652" returned: 0 in 0.335s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:42:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:42:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaaf1a21-cad7-4857-8714-c6e0fe46aca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5de6f10b-ab19-46a0-a1d7-215136442652', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (683446a6-75c8-4ea0-8753-5ef5ba5e4217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:28 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] Volume volume-5de6f10b-ab19-46a0-a1d7-215136442652 (5de6f10b-ab19-46a0-a1d7-215136442652): created successfully Sep 05 11:42:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (683446a6-75c8-4ea0-8753-5ef5ba5e4217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] Flow 'volume_create_manager' (31421ff5-f6fb-47ac-be98-5428514da098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:42:28 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2689ce0f-e9b1-4fc1-9a1a-6c47ba532b1b tempest-ProjectReaderTests-1241197718 None] Created volume successfully. Sep 05 11:42:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2f2ae424-6b5e-4249-953d-a823f80cdc00 tempest-ProjectReaderTests-1241197718 None] Acquiring lock "cinder-5de6f10b-ab19-46a0-a1d7-215136442652-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:42:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2f2ae424-6b5e-4249-953d-a823f80cdc00 tempest-ProjectReaderTests-1241197718 None] Lock "cinder-5de6f10b-ab19-46a0-a1d7-215136442652-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:42:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2f2ae424-6b5e-4249-953d-a823f80cdc00 tempest-ProjectReaderTests-1241197718 None] Acquiring lock "cinder-quobyte-5de6f10b-ab19-46a0-a1d7-215136442652" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:42:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2f2ae424-6b5e-4249-953d-a823f80cdc00 tempest-ProjectReaderTests-1241197718 None] Lock "cinder-quobyte-5de6f10b-ab19-46a0-a1d7-215136442652" acquired by "delete_volume" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:42:29 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d606483e-cfae-4b8e-b114-414187685fba]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:42:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2f2ae424-6b5e-4249-953d-a823f80cdc00 tempest-ProjectReaderTests-1241197718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5de6f10b-ab19-46a0-a1d7-215136442652 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:29 devstack sudo[98555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5de6f10b-ab19-46a0-a1d7-215136442652 Sep 05 11:42:29 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:29 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2f2ae424-6b5e-4249-953d-a823f80cdc00 tempest-ProjectReaderTests-1241197718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5de6f10b-ab19-46a0-a1d7-215136442652" returned: 0 in 0.432s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2f2ae424-6b5e-4249-953d-a823f80cdc00 tempest-ProjectReaderTests-1241197718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5de6f10b-ab19-46a0-a1d7-215136442652 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:29 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5de6f10b-ab19-46a0-a1d7-215136442652 Sep 05 11:42:29 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:30 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2f2ae424-6b5e-4249-953d-a823f80cdc00 tempest-ProjectReaderTests-1241197718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5de6f10b-ab19-46a0-a1d7-215136442652" returned: 0 in 0.325s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2f2ae424-6b5e-4249-953d-a823f80cdc00 tempest-ProjectReaderTests-1241197718 None] Lock "cinder-quobyte-5de6f10b-ab19-46a0-a1d7-215136442652" released by "delete_volume" :: held 0.832s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:42:30 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-2f2ae424-6b5e-4249-953d-a823f80cdc00 tempest-ProjectReaderTests-1241197718 None] Created reservations ['d1c806fd-20f8-4b82-92da-a2d39fb6d02d', 'fc1dd6d9-c4c9-4043-a80b-71ef0ae1be03', '7cec83f2-f62f-47c4-8f0f-6861400bec3a', 'da09b382-bdc8-4c11-aac5-a2bff815f274'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:42:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2f2ae424-6b5e-4249-953d-a823f80cdc00 tempest-ProjectReaderTests-1241197718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:42:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2f2ae424-6b5e-4249-953d-a823f80cdc00 tempest-ProjectReaderTests-1241197718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:42:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2f2ae424-6b5e-4249-953d-a823f80cdc00 tempest-ProjectReaderTests-1241197718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:42:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2f2ae424-6b5e-4249-953d-a823f80cdc00 tempest-ProjectReaderTests-1241197718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:42:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2f2ae424-6b5e-4249-953d-a823f80cdc00 tempest-ProjectReaderTests-1241197718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:42:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2f2ae424-6b5e-4249-953d-a823f80cdc00 tempest-ProjectReaderTests-1241197718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:30 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:42:30 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:30 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2f2ae424-6b5e-4249-953d-a823f80cdc00 tempest-ProjectReaderTests-1241197718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.307s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:30 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-2f2ae424-6b5e-4249-953d-a823f80cdc00 tempest-ProjectReaderTests-1241197718 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:42:30 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2f2ae424-6b5e-4249-953d-a823f80cdc00 tempest-ProjectReaderTests-1241197718 None] Deleted volume successfully. Sep 05 11:42:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2f2ae424-6b5e-4249-953d-a823f80cdc00 tempest-ProjectReaderTests-1241197718 None] Lock "cinder-5de6f10b-ab19-46a0-a1d7-215136442652-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:42:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:42:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:42:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:42:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:42:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:42:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:42:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:32 devstack sudo[98570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:42:32 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:32 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.316s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:32 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:42:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:42:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread count: 28 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 11:42:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread info: [<_MainThread(MainThread, started 131707869511808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 11:42:40 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=84,cinder:SELECT=63,cinder:INSERT=32,cinder:DELETE=10 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:42:40 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=65,cinder:UPDATE=99,cinder:INSERT=23,cinder:DELETE=5 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:42:47 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:42:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] Flow 'volume_create_manager' (c3939427-e31e-40d6-b363-4d0e05159a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:42:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f03ed681-b31f-4db1-8124-85ddcbb5c3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f03ed681-b31f-4db1-8124-85ddcbb5c3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-384527256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5035c76b-b46d-46b5-9217-1a20d36f8517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b706181cccd54c9d96d77b16989db921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:42:47Z,use_quota=True,user_id='88c26f7f046a49669e22a1ba9f170cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89f4f17-9aa3-48a9-87d7-1bda7ee93465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89f4f17-9aa3-48a9-87d7-1bda7ee93465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22d62b6d-546d-4cba-ad3c-2711ca55eb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22d62b6d-546d-4cba-ad3c-2711ca55eb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5035c76b-b46d-46b5-9217-1a20d36f8517', 'volume_name': 'volume-5035c76b-b46d-46b5-9217-1a20d36f8517', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (725f1812-68b1-4c7c-ada6-3f465c109aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (725f1812-68b1-4c7c-ada6-3f465c109aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48a0566c-300d-436f-a714-0a3e5f144174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:47 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] Volume 5035c76b-b46d-46b5-9217-1a20d36f8517: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5035c76b-b46d-46b5-9217-1a20d36f8517', 'volume_size': 1} Sep 05 11:42:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:42:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:42:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-384527256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5035c76b-b46d-46b5-9217-1a20d36f8517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b706181cccd54c9d96d77b16989db921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:42:47Z,use_quota=True,user_id='88c26f7f046a49669e22a1ba9f170cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:42:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] Creating volume 5035c76b-b46d-46b5-9217-1a20d36f8517 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:42:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:42:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:42:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:42:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:42:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:42:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:42:47 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:42:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5035c76b-b46d-46b5-9217-1a20d36f8517 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:47 devstack sudo[98576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5035c76b-b46d-46b5-9217-1a20d36f8517 1073741824 Sep 05 11:42:47 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:48 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5035c76b-b46d-46b5-9217-1a20d36f8517 1073741824" returned: 0 in 0.502s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5035c76b-b46d-46b5-9217-1a20d36f8517 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:48 devstack sudo[98582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5035c76b-b46d-46b5-9217-1a20d36f8517 Sep 05 11:42:48 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:48 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5035c76b-b46d-46b5-9217-1a20d36f8517" returned: 0 in 0.313s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:42:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:42:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48a0566c-300d-436f-a714-0a3e5f144174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5035c76b-b46d-46b5-9217-1a20d36f8517', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d829c1ec-dc55-463f-9eab-9a2131945269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:48 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] Volume volume-5035c76b-b46d-46b5-9217-1a20d36f8517 (5035c76b-b46d-46b5-9217-1a20d36f8517): created successfully Sep 05 11:42:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d829c1ec-dc55-463f-9eab-9a2131945269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] Flow 'volume_create_manager' (c3939427-e31e-40d6-b363-4d0e05159a20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:42:48 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-8a9e656c-26d7-4615-b8d1-043394e9a9e3 tempest-ProjectReaderTests-1579983702 None] Created volume successfully. Sep 05 11:42:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7ca8392f-5a0e-4293-bcc1-79dca0c62586 tempest-ProjectReaderTests-1579983702 None] Acquiring lock "cinder-5035c76b-b46d-46b5-9217-1a20d36f8517-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:42:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7ca8392f-5a0e-4293-bcc1-79dca0c62586 tempest-ProjectReaderTests-1579983702 None] Lock "cinder-5035c76b-b46d-46b5-9217-1a20d36f8517-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:42:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7ca8392f-5a0e-4293-bcc1-79dca0c62586 tempest-ProjectReaderTests-1579983702 None] Acquiring lock "cinder-quobyte-5035c76b-b46d-46b5-9217-1a20d36f8517" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:42:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7ca8392f-5a0e-4293-bcc1-79dca0c62586 tempest-ProjectReaderTests-1579983702 None] Lock "cinder-quobyte-5035c76b-b46d-46b5-9217-1a20d36f8517" acquired by "delete_volume" :: waited 0.025s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:42:50 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[24620130-c80b-44e0-b357-790756f25f37]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:42:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7ca8392f-5a0e-4293-bcc1-79dca0c62586 tempest-ProjectReaderTests-1579983702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5035c76b-b46d-46b5-9217-1a20d36f8517 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:50 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5035c76b-b46d-46b5-9217-1a20d36f8517 Sep 05 11:42:50 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:50 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7ca8392f-5a0e-4293-bcc1-79dca0c62586 tempest-ProjectReaderTests-1579983702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5035c76b-b46d-46b5-9217-1a20d36f8517" returned: 0 in 0.400s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7ca8392f-5a0e-4293-bcc1-79dca0c62586 tempest-ProjectReaderTests-1579983702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5035c76b-b46d-46b5-9217-1a20d36f8517 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:50 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5035c76b-b46d-46b5-9217-1a20d36f8517 Sep 05 11:42:50 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:50 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7ca8392f-5a0e-4293-bcc1-79dca0c62586 tempest-ProjectReaderTests-1579983702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5035c76b-b46d-46b5-9217-1a20d36f8517" returned: 0 in 0.290s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7ca8392f-5a0e-4293-bcc1-79dca0c62586 tempest-ProjectReaderTests-1579983702 None] Lock "cinder-quobyte-5035c76b-b46d-46b5-9217-1a20d36f8517" released by "delete_volume" :: held 0.750s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:42:50 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-7ca8392f-5a0e-4293-bcc1-79dca0c62586 tempest-ProjectReaderTests-1579983702 None] Created reservations ['efb99845-932e-481b-bf36-428b56b9af7c', '9a9a7376-96b5-4fa6-920e-c38c1a71ce56', '24544d05-6423-430e-9fe4-5d398da7839d', '7c8ee3ef-2028-4e29-8634-575ed64bcbbe'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:42:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7ca8392f-5a0e-4293-bcc1-79dca0c62586 tempest-ProjectReaderTests-1579983702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:42:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7ca8392f-5a0e-4293-bcc1-79dca0c62586 tempest-ProjectReaderTests-1579983702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:42:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7ca8392f-5a0e-4293-bcc1-79dca0c62586 tempest-ProjectReaderTests-1579983702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:42:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7ca8392f-5a0e-4293-bcc1-79dca0c62586 tempest-ProjectReaderTests-1579983702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:42:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7ca8392f-5a0e-4293-bcc1-79dca0c62586 tempest-ProjectReaderTests-1579983702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:42:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7ca8392f-5a0e-4293-bcc1-79dca0c62586 tempest-ProjectReaderTests-1579983702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:51 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:42:51 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:51 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7ca8392f-5a0e-4293-bcc1-79dca0c62586 tempest-ProjectReaderTests-1579983702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.372s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:51 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-7ca8392f-5a0e-4293-bcc1-79dca0c62586 tempest-ProjectReaderTests-1579983702 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:42:51 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7ca8392f-5a0e-4293-bcc1-79dca0c62586 tempest-ProjectReaderTests-1579983702 None] Deleted volume successfully. Sep 05 11:42:51 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7ca8392f-5a0e-4293-bcc1-79dca0c62586 tempest-ProjectReaderTests-1579983702 None] Lock "cinder-5035c76b-b46d-46b5-9217-1a20d36f8517-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:42:51 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:42:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] Flow 'volume_create_manager' (da8eeffd-9c97-42b9-8ae8-96767a8e4fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:42:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (203472a7-acd0-40d9-a025-350ee1278720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (203472a7-acd0-40d9-a025-350ee1278720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-168074030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad781d56-2a7d-496b-a3fa-e4a8e8621028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b706181cccd54c9d96d77b16989db921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:42:52Z,use_quota=True,user_id='88c26f7f046a49669e22a1ba9f170cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45b6b86-da31-4bcb-bcfd-a7aa1fcdf98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45b6b86-da31-4bcb-bcfd-a7aa1fcdf98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee228e0-bb05-4ead-8601-92aeb0e5877c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee228e0-bb05-4ead-8601-92aeb0e5877c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad781d56-2a7d-496b-a3fa-e4a8e8621028', 'volume_name': 'volume-ad781d56-2a7d-496b-a3fa-e4a8e8621028', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (706a0392-360a-492a-8943-c1d1b68d65a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (706a0392-360a-492a-8943-c1d1b68d65a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2d43a55-8d9e-4dd3-9e4d-571f9456ab92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:51 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] Volume ad781d56-2a7d-496b-a3fa-e4a8e8621028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad781d56-2a7d-496b-a3fa-e4a8e8621028', 'volume_size': 1} Sep 05 11:42:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:42:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:42:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-168074030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad781d56-2a7d-496b-a3fa-e4a8e8621028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b706181cccd54c9d96d77b16989db921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:42:52Z,use_quota=True,user_id='88c26f7f046a49669e22a1ba9f170cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:42:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] Creating volume ad781d56-2a7d-496b-a3fa-e4a8e8621028 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:42:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:42:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:42:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:42:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:42:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:42:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:42:51 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:42:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ad781d56-2a7d-496b-a3fa-e4a8e8621028 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:51 devstack sudo[98605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ad781d56-2a7d-496b-a3fa-e4a8e8621028 1073741824 Sep 05 11:42:51 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:52 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ad781d56-2a7d-496b-a3fa-e4a8e8621028 1073741824" returned: 0 in 0.662s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ad781d56-2a7d-496b-a3fa-e4a8e8621028 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:52 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ad781d56-2a7d-496b-a3fa-e4a8e8621028 Sep 05 11:42:52 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:52 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ad781d56-2a7d-496b-a3fa-e4a8e8621028" returned: 0 in 0.308s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:52 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:42:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:42:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2d43a55-8d9e-4dd3-9e4d-571f9456ab92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad781d56-2a7d-496b-a3fa-e4a8e8621028', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47074637-f133-427b-b14a-5780700186f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:52 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] Volume volume-ad781d56-2a7d-496b-a3fa-e4a8e8621028 (ad781d56-2a7d-496b-a3fa-e4a8e8621028): created successfully Sep 05 11:42:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47074637-f133-427b-b14a-5780700186f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] Flow 'volume_create_manager' (da8eeffd-9c97-42b9-8ae8-96767a8e4fff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:42:52 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3a6dbb01-e789-4e8e-b588-5dacdc806b72 tempest-ProjectReaderTests-1579983702 None] Created volume successfully. Sep 05 11:42:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-49464b6e-2648-4e13-a5ef-4cc98c5af5af tempest-ProjectReaderTests-1579983702 None] Acquiring lock "cinder-ad781d56-2a7d-496b-a3fa-e4a8e8621028-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:42:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-49464b6e-2648-4e13-a5ef-4cc98c5af5af tempest-ProjectReaderTests-1579983702 None] Lock "cinder-ad781d56-2a7d-496b-a3fa-e4a8e8621028-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:42:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-49464b6e-2648-4e13-a5ef-4cc98c5af5af tempest-ProjectReaderTests-1579983702 None] Acquiring lock "cinder-quobyte-ad781d56-2a7d-496b-a3fa-e4a8e8621028" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:42:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-49464b6e-2648-4e13-a5ef-4cc98c5af5af tempest-ProjectReaderTests-1579983702 None] Lock "cinder-quobyte-ad781d56-2a7d-496b-a3fa-e4a8e8621028" acquired by "delete_volume" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:42:53 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd528da6-ae69-491f-831d-53883fb4cb98]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:42:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-49464b6e-2648-4e13-a5ef-4cc98c5af5af tempest-ProjectReaderTests-1579983702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ad781d56-2a7d-496b-a3fa-e4a8e8621028 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:54 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ad781d56-2a7d-496b-a3fa-e4a8e8621028 Sep 05 11:42:54 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:54 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-49464b6e-2648-4e13-a5ef-4cc98c5af5af tempest-ProjectReaderTests-1579983702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ad781d56-2a7d-496b-a3fa-e4a8e8621028" returned: 0 in 0.436s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-49464b6e-2648-4e13-a5ef-4cc98c5af5af tempest-ProjectReaderTests-1579983702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ad781d56-2a7d-496b-a3fa-e4a8e8621028 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:54 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ad781d56-2a7d-496b-a3fa-e4a8e8621028 Sep 05 11:42:54 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:54 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-49464b6e-2648-4e13-a5ef-4cc98c5af5af tempest-ProjectReaderTests-1579983702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ad781d56-2a7d-496b-a3fa-e4a8e8621028" returned: 0 in 0.318s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-49464b6e-2648-4e13-a5ef-4cc98c5af5af tempest-ProjectReaderTests-1579983702 None] Lock "cinder-quobyte-ad781d56-2a7d-496b-a3fa-e4a8e8621028" released by "delete_volume" :: held 0.805s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:42:54 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-49464b6e-2648-4e13-a5ef-4cc98c5af5af tempest-ProjectReaderTests-1579983702 None] Created reservations ['d7c68fa1-0465-4b71-85c9-0f9ebd2daab6', '67c6e67a-de08-471f-a8e3-4274e8f4b790', '5ecee441-2a7a-4f4d-a35e-4359338fb8cd', '64db3e0f-5d69-4272-bbb9-ccb241ae8a9a'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:42:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-49464b6e-2648-4e13-a5ef-4cc98c5af5af tempest-ProjectReaderTests-1579983702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:42:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-49464b6e-2648-4e13-a5ef-4cc98c5af5af tempest-ProjectReaderTests-1579983702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:42:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-49464b6e-2648-4e13-a5ef-4cc98c5af5af tempest-ProjectReaderTests-1579983702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:42:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-49464b6e-2648-4e13-a5ef-4cc98c5af5af tempest-ProjectReaderTests-1579983702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:42:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-49464b6e-2648-4e13-a5ef-4cc98c5af5af tempest-ProjectReaderTests-1579983702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:42:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-49464b6e-2648-4e13-a5ef-4cc98c5af5af tempest-ProjectReaderTests-1579983702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:54 devstack sudo[98623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:42:54 devstack sudo[98623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:55 devstack sudo[98623]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-49464b6e-2648-4e13-a5ef-4cc98c5af5af tempest-ProjectReaderTests-1579983702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.476s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:55 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-49464b6e-2648-4e13-a5ef-4cc98c5af5af tempest-ProjectReaderTests-1579983702 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:42:55 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-49464b6e-2648-4e13-a5ef-4cc98c5af5af tempest-ProjectReaderTests-1579983702 None] Deleted volume successfully. Sep 05 11:42:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-49464b6e-2648-4e13-a5ef-4cc98c5af5af tempest-ProjectReaderTests-1579983702 None] Lock "cinder-ad781d56-2a7d-496b-a3fa-e4a8e8621028-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:42:55 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:42:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] Flow 'volume_create_manager' (8ba36969-04d2-45fb-bec3-f7fa4ed09ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:42:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d719d284-34e6-454d-9a02-14a41362c52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d719d284-34e6-454d-9a02-14a41362c52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1667675599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4104940-6f80-4387-b77d-c27ffa6e7565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b706181cccd54c9d96d77b16989db921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:42:56Z,use_quota=True,user_id='88c26f7f046a49669e22a1ba9f170cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad77036-cfde-4dae-987f-02c8ac1b672f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad77036-cfde-4dae-987f-02c8ac1b672f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e50f42-b0f4-4495-91d6-13f0aa539fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e50f42-b0f4-4495-91d6-13f0aa539fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4104940-6f80-4387-b77d-c27ffa6e7565', 'volume_name': 'volume-c4104940-6f80-4387-b77d-c27ffa6e7565', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a51fe34-a1e0-4666-8b1b-b7c0a25fadd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a51fe34-a1e0-4666-8b1b-b7c0a25fadd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f7e6aaf-ce7f-408c-b01a-1f9e72292e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:55 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] Volume c4104940-6f80-4387-b77d-c27ffa6e7565: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4104940-6f80-4387-b77d-c27ffa6e7565', 'volume_size': 1} Sep 05 11:42:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:42:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:42:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1667675599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4104940-6f80-4387-b77d-c27ffa6e7565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b706181cccd54c9d96d77b16989db921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:42:56Z,use_quota=True,user_id='88c26f7f046a49669e22a1ba9f170cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:42:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] Creating volume c4104940-6f80-4387-b77d-c27ffa6e7565 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:42:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:42:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:42:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:42:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:42:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:42:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:42:55 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:42:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c4104940-6f80-4387-b77d-c27ffa6e7565 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:55 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c4104940-6f80-4387-b77d-c27ffa6e7565 1073741824 Sep 05 11:42:55 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:56 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c4104940-6f80-4387-b77d-c27ffa6e7565 1073741824" returned: 0 in 0.537s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c4104940-6f80-4387-b77d-c27ffa6e7565 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:56 devstack sudo[98632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c4104940-6f80-4387-b77d-c27ffa6e7565 Sep 05 11:42:56 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:56 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c4104940-6f80-4387-b77d-c27ffa6e7565" returned: 0 in 0.294s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:42:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:42:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f7e6aaf-ce7f-408c-b01a-1f9e72292e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4104940-6f80-4387-b77d-c27ffa6e7565', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e1b2986-3871-427a-a0c5-314401bcfc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:42:56 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] Volume volume-c4104940-6f80-4387-b77d-c27ffa6e7565 (c4104940-6f80-4387-b77d-c27ffa6e7565): created successfully Sep 05 11:42:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e1b2986-3871-427a-a0c5-314401bcfc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:42:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] Flow 'volume_create_manager' (8ba36969-04d2-45fb-bec3-f7fa4ed09ef6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:42:56 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b1f87110-d87a-4af6-8ca4-8e9c5ef0f492 tempest-ProjectReaderTests-1579983702 None] Created volume successfully. Sep 05 11:42:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-565cb45f-dd8e-4baf-a32f-a3f6859c1440 tempest-ProjectReaderTests-1579983702 None] Acquiring lock "cinder-c4104940-6f80-4387-b77d-c27ffa6e7565-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:42:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-565cb45f-dd8e-4baf-a32f-a3f6859c1440 tempest-ProjectReaderTests-1579983702 None] Lock "cinder-c4104940-6f80-4387-b77d-c27ffa6e7565-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:42:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-565cb45f-dd8e-4baf-a32f-a3f6859c1440 tempest-ProjectReaderTests-1579983702 None] Acquiring lock "cinder-quobyte-c4104940-6f80-4387-b77d-c27ffa6e7565" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:42:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-565cb45f-dd8e-4baf-a32f-a3f6859c1440 tempest-ProjectReaderTests-1579983702 None] Lock "cinder-quobyte-c4104940-6f80-4387-b77d-c27ffa6e7565" acquired by "delete_volume" :: waited 0.028s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:42:58 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[910c5445-06f4-429a-bfc7-0ba013282306]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:42:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-565cb45f-dd8e-4baf-a32f-a3f6859c1440 tempest-ProjectReaderTests-1579983702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c4104940-6f80-4387-b77d-c27ffa6e7565 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:58 devstack sudo[98635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c4104940-6f80-4387-b77d-c27ffa6e7565 Sep 05 11:42:58 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:58 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-565cb45f-dd8e-4baf-a32f-a3f6859c1440 tempest-ProjectReaderTests-1579983702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c4104940-6f80-4387-b77d-c27ffa6e7565" returned: 0 in 0.591s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-565cb45f-dd8e-4baf-a32f-a3f6859c1440 tempest-ProjectReaderTests-1579983702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c4104940-6f80-4387-b77d-c27ffa6e7565 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:58 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c4104940-6f80-4387-b77d-c27ffa6e7565 Sep 05 11:42:58 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:59 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-565cb45f-dd8e-4baf-a32f-a3f6859c1440 tempest-ProjectReaderTests-1579983702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c4104940-6f80-4387-b77d-c27ffa6e7565" returned: 0 in 0.325s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-565cb45f-dd8e-4baf-a32f-a3f6859c1440 tempest-ProjectReaderTests-1579983702 None] Lock "cinder-quobyte-c4104940-6f80-4387-b77d-c27ffa6e7565" released by "delete_volume" :: held 1.000s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:42:59 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-565cb45f-dd8e-4baf-a32f-a3f6859c1440 tempest-ProjectReaderTests-1579983702 None] Created reservations ['412a945c-1962-4dfa-9110-a808ef8b9c5e', '9852e66f-17f7-4eaf-afdb-3d1bcecc33ae', '4f77931e-f77d-457b-a7a8-6d2851516659', 'd28638e3-7fe7-4573-adb1-7f8672493075'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:42:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-565cb45f-dd8e-4baf-a32f-a3f6859c1440 tempest-ProjectReaderTests-1579983702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:42:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-565cb45f-dd8e-4baf-a32f-a3f6859c1440 tempest-ProjectReaderTests-1579983702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:42:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-565cb45f-dd8e-4baf-a32f-a3f6859c1440 tempest-ProjectReaderTests-1579983702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:42:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-565cb45f-dd8e-4baf-a32f-a3f6859c1440 tempest-ProjectReaderTests-1579983702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:42:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-565cb45f-dd8e-4baf-a32f-a3f6859c1440 tempest-ProjectReaderTests-1579983702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:42:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-565cb45f-dd8e-4baf-a32f-a3f6859c1440 tempest-ProjectReaderTests-1579983702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:42:59 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:42:59 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:42:59 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Sep 05 11:42:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-565cb45f-dd8e-4baf-a32f-a3f6859c1440 tempest-ProjectReaderTests-1579983702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.269s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:42:59 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-565cb45f-dd8e-4baf-a32f-a3f6859c1440 tempest-ProjectReaderTests-1579983702 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:42:59 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-565cb45f-dd8e-4baf-a32f-a3f6859c1440 tempest-ProjectReaderTests-1579983702 None] Deleted volume successfully. Sep 05 11:42:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-565cb45f-dd8e-4baf-a32f-a3f6859c1440 tempest-ProjectReaderTests-1579983702 None] Lock "cinder-c4104940-6f80-4387-b77d-c27ffa6e7565-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:43:01 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:43:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] Flow 'volume_create_manager' (7a484459-db66-4415-8d60-8fc474d59e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:43:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ca6721-f882-450b-b723-4cddb026ce24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ca6721-f882-450b-b723-4cddb026ce24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-14536665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc130f72-270f-454a-9b71-37ff95599e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b706181cccd54c9d96d77b16989db921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:43:01Z,use_quota=True,user_id='88c26f7f046a49669e22a1ba9f170cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d989f45-08e6-4f53-a9ee-177e843e5ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d989f45-08e6-4f53-a9ee-177e843e5ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3afc922-8ef3-4f19-8fc1-91934fd6c0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3afc922-8ef3-4f19-8fc1-91934fd6c0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc130f72-270f-454a-9b71-37ff95599e99', 'volume_name': 'volume-cc130f72-270f-454a-9b71-37ff95599e99', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2cf714-0b95-4d2b-9a4a-59556b088fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2cf714-0b95-4d2b-9a4a-59556b088fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d355b58d-be48-48a4-b801-31d9c61f7e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:01 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] Volume cc130f72-270f-454a-9b71-37ff95599e99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc130f72-270f-454a-9b71-37ff95599e99', 'volume_size': 1} Sep 05 11:43:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-14536665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc130f72-270f-454a-9b71-37ff95599e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b706181cccd54c9d96d77b16989db921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:43:01Z,use_quota=True,user_id='88c26f7f046a49669e22a1ba9f170cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:43:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] Creating volume cc130f72-270f-454a-9b71-37ff95599e99 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:43:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:43:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:43:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:43:01 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:43:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cc130f72-270f-454a-9b71-37ff95599e99 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:01 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cc130f72-270f-454a-9b71-37ff95599e99 1073741824 Sep 05 11:43:01 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:01 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cc130f72-270f-454a-9b71-37ff95599e99 1073741824" returned: 0 in 0.582s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cc130f72-270f-454a-9b71-37ff95599e99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:01 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cc130f72-270f-454a-9b71-37ff95599e99 Sep 05 11:43:01 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:02 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cc130f72-270f-454a-9b71-37ff95599e99" returned: 0 in 0.319s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d355b58d-be48-48a4-b801-31d9c61f7e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc130f72-270f-454a-9b71-37ff95599e99', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba4e5e94-c422-457f-a81e-700bd2845ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:02 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] Volume volume-cc130f72-270f-454a-9b71-37ff95599e99 (cc130f72-270f-454a-9b71-37ff95599e99): created successfully Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba4e5e94-c422-457f-a81e-700bd2845ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] Flow 'volume_create_manager' (7a484459-db66-4415-8d60-8fc474d59e81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:43:02 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c0fadf2b-8db4-4d16-97cb-b9c9d54edb5e tempest-ProjectReaderTests-1579983702 None] Created volume successfully. Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] Flow 'volume_create_manager' (06bd14e5-868d-485f-852b-26518e156db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b19af61-7f0d-4373-9682-c0c740c2a89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b19af61-7f0d-4373-9682-c0c740c2a89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1270047365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1a384ec-faa0-48f6-ba30-b8b54b43c0f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3658218124574ad0b513342e94e5cd3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:43:02Z,use_quota=True,user_id='0b19025daa664cc1a32a17b2b4c41657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0109325d-e1b1-4980-82b8-9f018cacff34),volume_type_id=0109325d-e1b1-4980-82b8-9f018cacff34)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef85d159-1d11-468c-a63d-4ccd9cd0af12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef85d159-1d11-468c-a63d-4ccd9cd0af12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f17a8dc5-c80e-4a51-908e-279a3d475993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f17a8dc5-c80e-4a51-908e-279a3d475993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1a384ec-faa0-48f6-ba30-b8b54b43c0f8', 'volume_name': 'volume-d1a384ec-faa0-48f6-ba30-b8b54b43c0f8', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e4f29e1-677d-4c33-bd20-0a28784936d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e4f29e1-677d-4c33-bd20-0a28784936d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e6667b-c6b5-4d39-9503-388909d45e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:02 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] Volume d1a384ec-faa0-48f6-ba30-b8b54b43c0f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1a384ec-faa0-48f6-ba30-b8b54b43c0f8', 'volume_size': 1} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1270047365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1a384ec-faa0-48f6-ba30-b8b54b43c0f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3658218124574ad0b513342e94e5cd3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:43:02Z,use_quota=True,user_id='0b19025daa664cc1a32a17b2b4c41657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0109325d-e1b1-4980-82b8-9f018cacff34),volume_type_id=0109325d-e1b1-4980-82b8-9f018cacff34)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] Creating volume d1a384ec-faa0-48f6-ba30-b8b54b43c0f8 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:43:02 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1a384ec-faa0-48f6-ba30-b8b54b43c0f8 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:02 devstack sudo[98659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1a384ec-faa0-48f6-ba30-b8b54b43c0f8 1073741824 Sep 05 11:43:02 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] Flow 'volume_create_manager' (76b1121e-f8a7-43ce-a2b0-188755f9177f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50bb921d-6dbf-48b7-8ffa-72f92b4b8680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50bb921d-6dbf-48b7-8ffa-72f92b4b8680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1941229001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f8b484-5f65-4e75-b0f9-dfbf50d8a64b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3658218124574ad0b513342e94e5cd3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:43:03Z,use_quota=True,user_id='0b19025daa664cc1a32a17b2b4c41657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f03f0a32-4af6-4a2e-8118-98db43cd664d),volume_type_id=f03f0a32-4af6-4a2e-8118-98db43cd664d)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ddd335c-8157-4876-abb3-36f4422c5c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ddd335c-8157-4876-abb3-36f4422c5c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16585de-dcec-4232-8662-88d25abcf49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16585de-dcec-4232-8662-88d25abcf49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8f8b484-5f65-4e75-b0f9-dfbf50d8a64b', 'volume_name': 'volume-e8f8b484-5f65-4e75-b0f9-dfbf50d8a64b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f98f6c-28b2-4c9e-ab3d-471ff25fe4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f98f6c-28b2-4c9e-ab3d-471ff25fe4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37bd7416-c396-4902-954f-77c8d93c370f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:02 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] Volume e8f8b484-5f65-4e75-b0f9-dfbf50d8a64b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8f8b484-5f65-4e75-b0f9-dfbf50d8a64b', 'volume_size': 1} Sep 05 11:43:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:03 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1a384ec-faa0-48f6-ba30-b8b54b43c0f8 1073741824" returned: 0 in 0.785s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3f7a70ba-b50d-48cc-a3d2-17d9d8b582b0 tempest-ProjectReaderTests-1579983702 None] Acquiring lock "cinder-cc130f72-270f-454a-9b71-37ff95599e99-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:43:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3f7a70ba-b50d-48cc-a3d2-17d9d8b582b0 tempest-ProjectReaderTests-1579983702 None] Lock "cinder-cc130f72-270f-454a-9b71-37ff95599e99-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:43:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1a384ec-faa0-48f6-ba30-b8b54b43c0f8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:03 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1a384ec-faa0-48f6-ba30-b8b54b43c0f8 Sep 05 11:43:03 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3f7a70ba-b50d-48cc-a3d2-17d9d8b582b0 tempest-ProjectReaderTests-1579983702 None] Acquiring lock "cinder-quobyte-cc130f72-270f-454a-9b71-37ff95599e99" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:43:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3f7a70ba-b50d-48cc-a3d2-17d9d8b582b0 tempest-ProjectReaderTests-1579983702 None] Lock "cinder-quobyte-cc130f72-270f-454a-9b71-37ff95599e99" acquired by "delete_volume" :: waited 0.039s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:43:03 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ceac0c-f938-463d-b994-50d78fe5bcc5]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:43:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f7a70ba-b50d-48cc-a3d2-17d9d8b582b0 tempest-ProjectReaderTests-1579983702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cc130f72-270f-454a-9b71-37ff95599e99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:03 devstack sudo[98673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cc130f72-270f-454a-9b71-37ff95599e99 Sep 05 11:43:03 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:03 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1a384ec-faa0-48f6-ba30-b8b54b43c0f8" returned: 0 in 0.479s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:43:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.966s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1941229001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f8b484-5f65-4e75-b0f9-dfbf50d8a64b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3658218124574ad0b513342e94e5cd3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:43:03Z,use_quota=True,user_id='0b19025daa664cc1a32a17b2b4c41657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f03f0a32-4af6-4a2e-8118-98db43cd664d),volume_type_id=f03f0a32-4af6-4a2e-8118-98db43cd664d)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:43:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] Creating volume e8f8b484-5f65-4e75-b0f9-dfbf50d8a64b {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:43:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:43:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:43:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:43:03 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:43:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e8f8b484-5f65-4e75-b0f9-dfbf50d8a64b 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:03 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e8f8b484-5f65-4e75-b0f9-dfbf50d8a64b 1073741824 Sep 05 11:43:03 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e6667b-c6b5-4d39-9503-388909d45e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1a384ec-faa0-48f6-ba30-b8b54b43c0f8', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d87fb69d-f0f8-4157-8e13-102574e0651c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:04 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:43:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Flow 'volume_create_manager' (f5acb14d-2b89-4cb8-ad3a-7ec4e2027042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:43:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b17bc93-c64b-4b19-8457-d04d7b6fbe12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:04 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] Volume volume-d1a384ec-faa0-48f6-ba30-b8b54b43c0f8 (d1a384ec-faa0-48f6-ba30-b8b54b43c0f8): created successfully Sep 05 11:43:04 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d87fb69d-f0f8-4157-8e13-102574e0651c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] Flow 'volume_create_manager' (06bd14e5-868d-485f-852b-26518e156db0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:43:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f7a70ba-b50d-48cc-a3d2-17d9d8b582b0 tempest-ProjectReaderTests-1579983702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cc130f72-270f-454a-9b71-37ff95599e99" returned: 0 in 0.640s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f7a70ba-b50d-48cc-a3d2-17d9d8b582b0 tempest-ProjectReaderTests-1579983702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cc130f72-270f-454a-9b71-37ff95599e99 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:04 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6cf1a22e-01c7-4cac-8d04-fc5664228513 tempest-TestInstancesWithCinderVolumes-422999212 None] Created volume successfully. Sep 05 11:43:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b17bc93-c64b-4b19-8457-d04d7b6fbe12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-749604483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae2e6d16-1b0f-460e-b81b-65d5d669a666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3658218124574ad0b513342e94e5cd3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:43:04Z,use_quota=True,user_id='0b19025daa664cc1a32a17b2b4c41657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(557dbcbf-3ba4-422a-b1e2-81de10a5fae1),volume_type_id=557dbcbf-3ba4-422a-b1e2-81de10a5fae1)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14236647-fecb-451e-8536-09d51911319f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:04 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cc130f72-270f-454a-9b71-37ff95599e99 Sep 05 11:43:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14236647-fecb-451e-8536-09d51911319f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:04 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3797518-d623-4dac-a78c-4361699c072a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:04 devstack cinder-volume[87517]: DEBUG cinder.image.glance [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Creating Keystone auth plugin from conf {{(pid=87517) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 11:43:04 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e8f8b484-5f65-4e75-b0f9-dfbf50d8a64b 1073741824" returned: 0 in 0.660s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e8f8b484-5f65-4e75-b0f9-dfbf50d8a64b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:04 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f7a70ba-b50d-48cc-a3d2-17d9d8b582b0 tempest-ProjectReaderTests-1579983702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cc130f72-270f-454a-9b71-37ff95599e99" returned: 0 in 0.446s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:04 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e8f8b484-5f65-4e75-b0f9-dfbf50d8a64b Sep 05 11:43:04 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:04 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3f7a70ba-b50d-48cc-a3d2-17d9d8b582b0 tempest-ProjectReaderTests-1579983702 None] Lock "cinder-quobyte-cc130f72-270f-454a-9b71-37ff95599e99" released by "delete_volume" :: held 1.157s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:43:04 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-3f7a70ba-b50d-48cc-a3d2-17d9d8b582b0 tempest-ProjectReaderTests-1579983702 None] Created reservations ['89c7c90c-88a7-4f8c-820f-b88a0ccda6eb', '5e7cf82c-7734-4b76-8925-2182a87fecdd', '8be372fd-898c-4630-b763-a5895ee3fcfd', '20eadcfd-e21f-40df-8409-f7f232f23e35'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:43:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3797518-d623-4dac-a78c-4361699c072a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ae2e6d16-1b0f-460e-b81b-65d5d669a666', 'volume_name': 'volume-ae2e6d16-1b0f-460e-b81b-65d5d669a666', 'volume_size': 1, 'image_id': '21077fbd-37ac-47cf-a1c9-259856bcfbf4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21077fbd-37ac-47cf-a1c9-259856bcfbf4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1995231159', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3658218124574ad0b513342e94e5cd3b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21077fbd-37ac-47cf-a1c9-259856bcfbf4', 'created_at': datetime.datetime(2026, 9, 5, 9, 42, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 9, 43, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21077fbd-37ac-47cf-a1c9-259856bcfbf4/file', 'properties': {}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f3cc1c-fff1-4cbf-935c-94310f6b7486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f3cc1c-fff1-4cbf-935c-94310f6b7486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf7464c-2000-4436-98ea-037319dc7e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:04 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Volume ae2e6d16-1b0f-460e-b81b-65d5d669a666: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ae2e6d16-1b0f-460e-b81b-65d5d669a666', 'volume_size': 1, 'image_id': '21077fbd-37ac-47cf-a1c9-259856bcfbf4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21077fbd-37ac-47cf-a1c9-259856bcfbf4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1995231159', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3658218124574ad0b513342e94e5cd3b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21077fbd-37ac-47cf-a1c9-259856bcfbf4', 'created_at': datetime.datetime(2026, 9, 5, 9, 42, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 9, 43, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21077fbd-37ac-47cf-a1c9-259856bcfbf4/file', 'properties': {}}, 'image_service': } Sep 05 11:43:04 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Trying to clone ae2e6d16-1b0f-460e-b81b-65d5d669a666 from image 21077fbd-37ac-47cf-a1c9-259856bcfbf4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/21077fbd-37ac-47cf-a1c9-259856bcfbf4', 'metadata': {}}]). {{(pid=87517) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 11:43:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3f7a70ba-b50d-48cc-a3d2-17d9d8b582b0 tempest-ProjectReaderTests-1579983702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3f7a70ba-b50d-48cc-a3d2-17d9d8b582b0 tempest-ProjectReaderTests-1579983702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3f7a70ba-b50d-48cc-a3d2-17d9d8b582b0 tempest-ProjectReaderTests-1579983702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:43:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3f7a70ba-b50d-48cc-a3d2-17d9d8b582b0 tempest-ProjectReaderTests-1579983702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:43:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3f7a70ba-b50d-48cc-a3d2-17d9d8b582b0 tempest-ProjectReaderTests-1579983702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f7a70ba-b50d-48cc-a3d2-17d9d8b582b0 tempest-ProjectReaderTests-1579983702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:04 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e8f8b484-5f65-4e75-b0f9-dfbf50d8a64b" returned: 0 in 0.351s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:43:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:05 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:43:05 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37bd7416-c396-4902-954f-77c8d93c370f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8f8b484-5f65-4e75-b0f9-dfbf50d8a64b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dbcf3f9-260e-4c0c-966f-700c0dd67ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:05 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] Volume volume-e8f8b484-5f65-4e75-b0f9-dfbf50d8a64b (e8f8b484-5f65-4e75-b0f9-dfbf50d8a64b): created successfully Sep 05 11:43:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dbcf3f9-260e-4c0c-966f-700c0dd67ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] Flow 'volume_create_manager' (76b1121e-f8a7-43ce-a2b0-188755f9177f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:43:05 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a15dda48-7d3a-40e2-ac67-5795cd5d07d8 tempest-TestInstancesWithCinderVolumes-422999212 None] Created volume successfully. Sep 05 11:43:05 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3f7a70ba-b50d-48cc-a3d2-17d9d8b582b0 tempest-ProjectReaderTests-1579983702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.333s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:05 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-3f7a70ba-b50d-48cc-a3d2-17d9d8b582b0 tempest-ProjectReaderTests-1579983702 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:43:05 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3f7a70ba-b50d-48cc-a3d2-17d9d8b582b0 tempest-ProjectReaderTests-1579983702 None] Deleted volume successfully. Sep 05 11:43:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3f7a70ba-b50d-48cc-a3d2-17d9d8b582b0 tempest-ProjectReaderTests-1579983702 None] Lock "cinder-cc130f72-270f-454a-9b71-37ff95599e99-delete_volume" released by "delete_volume" :: held 1.989s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:43:10 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_21077fbd-37ac-47cf-a1c9-259856bcfbf4_33kb8_d0devstack@QuobyteHD, size 20.69 MB, duration 5.24 sec {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 11:43:10 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Image download 20.69 MB at 3.95 MB/s Sep 05 11:43:10 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1037ab-acb4-4217-871b-f5c388093e59]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:43:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21077fbd-37ac-47cf-a1c9-259856bcfbf4_33kb8_d0devstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:10 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:43:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] Flow 'volume_create_manager' (f1b18b2e-b3ad-4851-8d4f-d8310170d946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:43:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e0e7d08-6033-440d-8e9f-3d29308ccf88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e0e7d08-6033-440d-8e9f-3d29308ccf88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1886315788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9391706f-a8f8-4877-95be-5863ddf67558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee54f8ded304d30b3386d225b29cfbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:43:10Z,use_quota=True,user_id='0588a6f622324e0d98d2cf6f87994444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4013f218-f500-4c06-816e-c593a762d2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4013f218-f500-4c06-816e-c593a762d2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (060fcc52-8d16-448f-ad7d-fe2d3c36545b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (060fcc52-8d16-448f-ad7d-fe2d3c36545b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9391706f-a8f8-4877-95be-5863ddf67558', 'volume_name': 'volume-9391706f-a8f8-4877-95be-5863ddf67558', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e4a39c-408a-42c8-a548-5964cf32b75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e4a39c-408a-42c8-a548-5964cf32b75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0e75fa5-8fab-4f23-80f4-95714771ab5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:10 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] Volume 9391706f-a8f8-4877-95be-5863ddf67558: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9391706f-a8f8-4877-95be-5863ddf67558', 'volume_size': 1} Sep 05 11:43:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1886315788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9391706f-a8f8-4877-95be-5863ddf67558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee54f8ded304d30b3386d225b29cfbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:43:10Z,use_quota=True,user_id='0588a6f622324e0d98d2cf6f87994444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:43:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] Creating volume 9391706f-a8f8-4877-95be-5863ddf67558 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:43:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:43:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:43:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:43:10 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:43:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9391706f-a8f8-4877-95be-5863ddf67558 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:10 devstack sudo[98774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21077fbd-37ac-47cf-a1c9-259856bcfbf4_33kb8_d0devstack@QuobyteHD Sep 05 11:43:10 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:10 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9391706f-a8f8-4877-95be-5863ddf67558 1073741824 Sep 05 11:43:10 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:10 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21077fbd-37ac-47cf-a1c9-259856bcfbf4_33kb8_d0devstack@QuobyteHD" returned: 0 in 0.457s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:10 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Temporary image 21077fbd-37ac-47cf-a1c9-259856bcfbf4 is fetched for user 0b19025daa664cc1a32a17b2b4c41657. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 11:43:10 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c67d3e6-b3f5-412a-8043-ccc510655264]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:43:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21077fbd-37ac-47cf-a1c9-259856bcfbf4_33kb8_d0devstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:10 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21077fbd-37ac-47cf-a1c9-259856bcfbf4_33kb8_d0devstack@QuobyteHD Sep 05 11:43:10 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:10 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9391706f-a8f8-4877-95be-5863ddf67558 1073741824" returned: 0 in 0.509s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9391706f-a8f8-4877-95be-5863ddf67558 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:11 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9391706f-a8f8-4877-95be-5863ddf67558 Sep 05 11:43:11 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:11 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21077fbd-37ac-47cf-a1c9-259856bcfbf4_33kb8_d0devstack@QuobyteHD" returned: 0 in 0.366s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:11 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9391706f-a8f8-4877-95be-5863ddf67558" returned: 0 in 0.338s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:43:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.158s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-749604483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae2e6d16-1b0f-460e-b81b-65d5d669a666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3658218124574ad0b513342e94e5cd3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:43:04Z,use_quota=True,user_id='0b19025daa664cc1a32a17b2b4c41657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(557dbcbf-3ba4-422a-b1e2-81de10a5fae1),volume_type_id=557dbcbf-3ba4-422a-b1e2-81de10a5fae1)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:43:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Creating volume ae2e6d16-1b0f-460e-b81b-65d5d669a666 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:43:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:43:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:43:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:43:11 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:43:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ae2e6d16-1b0f-460e-b81b-65d5d669a666 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0e75fa5-8fab-4f23-80f4-95714771ab5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9391706f-a8f8-4877-95be-5863ddf67558', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:11 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ae2e6d16-1b0f-460e-b81b-65d5d669a666 1073741824 Sep 05 11:43:11 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b370f6fb-9fc8-44bc-b080-648b755177b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:11 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] Volume volume-9391706f-a8f8-4877-95be-5863ddf67558 (9391706f-a8f8-4877-95be-5863ddf67558): created successfully Sep 05 11:43:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b370f6fb-9fc8-44bc-b080-648b755177b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] Flow 'volume_create_manager' (f1b18b2e-b3ad-4851-8d4f-d8310170d946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:43:11 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b59bbf1d-ceee-48f2-8abc-6c1d4d9298f3 tempest-VolumesActionsTest-1505352450 None] Created volume successfully. Sep 05 11:43:11 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ae2e6d16-1b0f-460e-b81b-65d5d669a666 1073741824" returned: 0 in 0.490s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ae2e6d16-1b0f-460e-b81b-65d5d669a666 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:11 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ae2e6d16-1b0f-460e-b81b-65d5d669a666 Sep 05 11:43:11 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:12 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ae2e6d16-1b0f-460e-b81b-65d5d669a666" returned: 0 in 0.247s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:43:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:12 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Attempting download of 21077fbd-37ac-47cf-a1c9-259856bcfbf4 ((None, [{'url': 'file:///opt/stack/data/glance/images/21077fbd-37ac-47cf-a1c9-259856bcfbf4', 'metadata': {}}])) to volume ae2e6d16-1b0f-460e-b81b-65d5d669a666. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 11:43:12 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f89084e-80e5-44ab-ba0e-163ecf477ecc]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:43:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21077fbd-37ac-47cf-a1c9-259856bcfbf4_h23wsvxn {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fb934c3b-ea8b-46af-9ab8-e1ca2fc19d5d tempest-VolumesActionsTest-1505352450 None] Acquiring lock "cinder-9391706f-a8f8-4877-95be-5863ddf67558" by "attach_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:43:12 devstack sudo[98804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21077fbd-37ac-47cf-a1c9-259856bcfbf4_h23wsvxn Sep 05 11:43:12 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fb934c3b-ea8b-46af-9ab8-e1ca2fc19d5d tempest-VolumesActionsTest-1505352450 None] Lock "cinder-9391706f-a8f8-4877-95be-5863ddf67558" acquired by "attach_volume" :: waited 0.026s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:43:12 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-fb934c3b-ea8b-46af-9ab8-e1ca2fc19d5d tempest-VolumesActionsTest-1505352450 None] Attaching volume 9391706f-a8f8-4877-95be-5863ddf67558 to instance 069902ae-8723-420e-b2bc-82be80ec692d at mountpoint /dev/vdb on host None. Sep 05 11:43:12 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-fb934c3b-ea8b-46af-9ab8-e1ca2fc19d5d tempest-VolumesActionsTest-1505352450 None] Attach volume completed successfully. Sep 05 11:43:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fb934c3b-ea8b-46af-9ab8-e1ca2fc19d5d tempest-VolumesActionsTest-1505352450 None] Lock "cinder-9391706f-a8f8-4877-95be-5863ddf67558" released by "attach_volume" :: held 0.108s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:43:12 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21077fbd-37ac-47cf-a1c9-259856bcfbf4_h23wsvxn" returned: 0 in 0.384s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21077fbd-37ac-47cf-a1c9-259856bcfbf4_h23wsvxn {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:12 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21077fbd-37ac-47cf-a1c9-259856bcfbf4_h23wsvxn Sep 05 11:43:12 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:12 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21077fbd-37ac-47cf-a1c9-259856bcfbf4_h23wsvxn" returned: 1 in 0.379s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21077fbd-37ac-47cf-a1c9-259856bcfbf4_h23wsvxn' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 11:43:13 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[226d3e8e-b9ab-4dbe-a457-8232f95454e9]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:43:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21077fbd-37ac-47cf-a1c9-259856bcfbf4_33kb8_d0devstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:13 devstack sudo[98812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21077fbd-37ac-47cf-a1c9-259856bcfbf4_33kb8_d0devstack@QuobyteHD Sep 05 11:43:13 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:13 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2731a3b2-7bd7-4890-9d0a-67bdf9a3b267 tempest-VolumesActionsTest-1814542065 None] Terminate volume connection completed successfully. Sep 05 11:43:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2731a3b2-7bd7-4890-9d0a-67bdf9a3b267 tempest-VolumesActionsTest-1814542065 None] Acquiring lock "cinder-9391706f-a8f8-4877-95be-5863ddf67558-detach_volume" by "detach_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:43:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2731a3b2-7bd7-4890-9d0a-67bdf9a3b267 tempest-VolumesActionsTest-1814542065 None] Lock "cinder-9391706f-a8f8-4877-95be-5863ddf67558-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:43:13 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2731a3b2-7bd7-4890-9d0a-67bdf9a3b267 tempest-VolumesActionsTest-1814542065 None] Detaching volume 9391706f-a8f8-4877-95be-5863ddf67558 from instance 069902ae-8723-420e-b2bc-82be80ec692d. Sep 05 11:43:13 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2731a3b2-7bd7-4890-9d0a-67bdf9a3b267 tempest-VolumesActionsTest-1814542065 None] Detach volume completed successfully. Sep 05 11:43:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2731a3b2-7bd7-4890-9d0a-67bdf9a3b267 tempest-VolumesActionsTest-1814542065 None] Lock "cinder-9391706f-a8f8-4877-95be-5863ddf67558-detach_volume" released by "detach_volume" :: held 0.082s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:43:13 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21077fbd-37ac-47cf-a1c9-259856bcfbf4_33kb8_d0devstack@QuobyteHD" returned: 0 in 0.410s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:13 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] 21077fbd-37ac-47cf-a1c9-259856bcfbf4 was qcow2, converting to qcow2 {{(pid=87517) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 11:43:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21077fbd-37ac-47cf-a1c9-259856bcfbf4_33kb8_d0devstack@QuobyteHD /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ae2e6d16-1b0f-460e-b81b-65d5d669a666 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:13 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21077fbd-37ac-47cf-a1c9-259856bcfbf4_33kb8_d0devstack@QuobyteHD /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ae2e6d16-1b0f-460e-b81b-65d5d669a666 Sep 05 11:43:13 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3b5c522b-bdef-4713-b610-7ab931ef7162 tempest-VolumesActionsTest-1505352450 None] Acquiring lock "cinder-9391706f-a8f8-4877-95be-5863ddf67558-detach_volume" by "detach_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:43:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3b5c522b-bdef-4713-b610-7ab931ef7162 tempest-VolumesActionsTest-1505352450 None] Lock "cinder-9391706f-a8f8-4877-95be-5863ddf67558-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:43:13 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3b5c522b-bdef-4713-b610-7ab931ef7162 tempest-VolumesActionsTest-1505352450 None] Volume detach called, but volume not attached. Sep 05 11:43:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3b5c522b-bdef-4713-b610-7ab931ef7162 tempest-VolumesActionsTest-1505352450 None] Lock "cinder-9391706f-a8f8-4877-95be-5863ddf67558-detach_volume" released by "detach_volume" :: held 0.026s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:43:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-32313335-6c6d-47df-bf94-6e3461404671 tempest-VolumesActionsTest-1505352450 None] Acquiring lock "cinder-9391706f-a8f8-4877-95be-5863ddf67558-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:43:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-32313335-6c6d-47df-bf94-6e3461404671 tempest-VolumesActionsTest-1505352450 None] Lock "cinder-9391706f-a8f8-4877-95be-5863ddf67558-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:43:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-32313335-6c6d-47df-bf94-6e3461404671 tempest-VolumesActionsTest-1505352450 None] Acquiring lock "cinder-quobyte-9391706f-a8f8-4877-95be-5863ddf67558" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:43:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-32313335-6c6d-47df-bf94-6e3461404671 tempest-VolumesActionsTest-1505352450 None] Lock "cinder-quobyte-9391706f-a8f8-4877-95be-5863ddf67558" acquired by "delete_volume" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:43:14 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6bbcac-dff5-47f1-a7dc-bb5e37f01723]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:43:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-32313335-6c6d-47df-bf94-6e3461404671 tempest-VolumesActionsTest-1505352450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9391706f-a8f8-4877-95be-5863ddf67558 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:14 devstack sudo[98824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9391706f-a8f8-4877-95be-5863ddf67558 Sep 05 11:43:14 devstack sudo[98824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:14 devstack sudo[98824]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-32313335-6c6d-47df-bf94-6e3461404671 tempest-VolumesActionsTest-1505352450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9391706f-a8f8-4877-95be-5863ddf67558" returned: 0 in 0.473s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-32313335-6c6d-47df-bf94-6e3461404671 tempest-VolumesActionsTest-1505352450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9391706f-a8f8-4877-95be-5863ddf67558 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:14 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9391706f-a8f8-4877-95be-5863ddf67558 Sep 05 11:43:14 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:14 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-32313335-6c6d-47df-bf94-6e3461404671 tempest-VolumesActionsTest-1505352450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9391706f-a8f8-4877-95be-5863ddf67558" returned: 0 in 0.364s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-32313335-6c6d-47df-bf94-6e3461404671 tempest-VolumesActionsTest-1505352450 None] Lock "cinder-quobyte-9391706f-a8f8-4877-95be-5863ddf67558" released by "delete_volume" :: held 0.887s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:43:14 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-32313335-6c6d-47df-bf94-6e3461404671 tempest-VolumesActionsTest-1505352450 None] Created reservations ['2d279380-e73b-42b6-a172-155b6d8ee733', 'ab316add-a230-4aca-9f35-d01a017c6ec1', 'b1a4be72-c7c8-4658-babf-76723515fe45', '813bd586-3116-4cef-b306-356eae72695d'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:43:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-32313335-6c6d-47df-bf94-6e3461404671 tempest-VolumesActionsTest-1505352450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-32313335-6c6d-47df-bf94-6e3461404671 tempest-VolumesActionsTest-1505352450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-32313335-6c6d-47df-bf94-6e3461404671 tempest-VolumesActionsTest-1505352450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:43:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-32313335-6c6d-47df-bf94-6e3461404671 tempest-VolumesActionsTest-1505352450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:43:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-32313335-6c6d-47df-bf94-6e3461404671 tempest-VolumesActionsTest-1505352450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-32313335-6c6d-47df-bf94-6e3461404671 tempest-VolumesActionsTest-1505352450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:15 devstack sudo[98835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:43:15 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:15 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-32313335-6c6d-47df-bf94-6e3461404671 tempest-VolumesActionsTest-1505352450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.384s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:15 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-32313335-6c6d-47df-bf94-6e3461404671 tempest-VolumesActionsTest-1505352450 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:43:15 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-32313335-6c6d-47df-bf94-6e3461404671 tempest-VolumesActionsTest-1505352450 None] Deleted volume successfully. Sep 05 11:43:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-32313335-6c6d-47df-bf94-6e3461404671 tempest-VolumesActionsTest-1505352450 None] Lock "cinder-9391706f-a8f8-4877-95be-5863ddf67558-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:43:15 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21077fbd-37ac-47cf-a1c9-259856bcfbf4_33kb8_d0devstack@QuobyteHD /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ae2e6d16-1b0f-460e-b81b-65d5d669a666" returned: 0 in 2.075s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:15 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_21077fbd-37ac-47cf-a1c9-259856bcfbf4_33kb8_d0devstack@QuobyteHD, size 112.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ae2e6d16-1b0f-460e-b81b-65d5d669a666 {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 11:43:15 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Converted 112.00 MB image at 53.94 MB/s Sep 05 11:43:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ae2e6d16-1b0f-460e-b81b-65d5d669a666 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:15 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ae2e6d16-1b0f-460e-b81b-65d5d669a666 1G Sep 05 11:43:15 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:15 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ae2e6d16-1b0f-460e-b81b-65d5d669a666 1G" returned: 0 in 0.483s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:15 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Downloaded image 21077fbd-37ac-47cf-a1c9-259856bcfbf4 ((None, [{'url': 'file:///opt/stack/data/glance/images/21077fbd-37ac-47cf-a1c9-259856bcfbf4', 'metadata': {}}])) to volume ae2e6d16-1b0f-460e-b81b-65d5d669a666 successfully. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 11:43:15 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Temporary image 21077fbd-37ac-47cf-a1c9-259856bcfbf4 for user 0b19025daa664cc1a32a17b2b4c41657 is deleted. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 11:43:15 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Marking volume ae2e6d16-1b0f-460e-b81b-65d5d669a666 as bootable. {{(pid=87517) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 11:43:16 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Copying metadata from image 21077fbd-37ac-47cf-a1c9-259856bcfbf4 to ae2e6d16-1b0f-460e-b81b-65d5d669a666. {{(pid=87517) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 11:43:16 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Creating volume glance metadata for volume ae2e6d16-1b0f-460e-b81b-65d5d669a666 backed by image 21077fbd-37ac-47cf-a1c9-259856bcfbf4 with: {'image_id': '21077fbd-37ac-47cf-a1c9-259856bcfbf4', 'image_name': 'tempest-scenario-img--1995231159', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87517) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 11:43:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf7464c-2000-4436-98ea-037319dc7e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae2e6d16-1b0f-460e-b81b-65d5d669a666', 'volume_size': 1, 'image_id': '21077fbd-37ac-47cf-a1c9-259856bcfbf4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21077fbd-37ac-47cf-a1c9-259856bcfbf4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1995231159', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3658218124574ad0b513342e94e5cd3b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21077fbd-37ac-47cf-a1c9-259856bcfbf4', 'created_at': datetime.datetime(2026, 9, 5, 9, 42, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 9, 43, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21077fbd-37ac-47cf-a1c9-259856bcfbf4/file', 'properties': {}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21063aeb-1da4-4d92-9162-2cbd25905766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:16 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Volume volume-ae2e6d16-1b0f-460e-b81b-65d5d669a666 (ae2e6d16-1b0f-460e-b81b-65d5d669a666): created successfully Sep 05 11:43:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21063aeb-1da4-4d92-9162-2cbd25905766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Flow 'volume_create_manager' (f5acb14d-2b89-4cb8-ad3a-7ec4e2027042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:43:16 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ec51469d-7d46-4006-a5df-9fe76561c7c3 tempest-TestInstancesWithCinderVolumes-422999212 None] Created volume successfully. Sep 05 11:43:18 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:43:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] Flow 'volume_create_manager' (8eed23ad-7c96-456d-aeaa-b0b7a1865c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:43:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c565e5-4078-4d2a-894d-42b7ab977999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c565e5-4078-4d2a-894d-42b7ab977999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:43:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1439916343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69720f87-5516-4d03-bc70-3302a21f5830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee54f8ded304d30b3386d225b29cfbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:43:18Z,use_quota=True,user_id='0588a6f622324e0d98d2cf6f87994444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b33587a-5624-443c-8800-80ffeae2218b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b33587a-5624-443c-8800-80ffeae2218b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b99b3365-8630-4185-a073-e6c295170411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b99b3365-8630-4185-a073-e6c295170411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69720f87-5516-4d03-bc70-3302a21f5830', 'volume_name': 'volume-69720f87-5516-4d03-bc70-3302a21f5830', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad61405d-f573-43a1-9de3-316da0aea819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad61405d-f573-43a1-9de3-316da0aea819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8dd1b99-3880-46dd-8474-e0a1a953140e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:18 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] Volume 69720f87-5516-4d03-bc70-3302a21f5830: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69720f87-5516-4d03-bc70-3302a21f5830', 'volume_size': 1} Sep 05 11:43:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:43:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1439916343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69720f87-5516-4d03-bc70-3302a21f5830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee54f8ded304d30b3386d225b29cfbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:43:18Z,use_quota=True,user_id='0588a6f622324e0d98d2cf6f87994444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:43:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] Creating volume 69720f87-5516-4d03-bc70-3302a21f5830 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:43:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:43:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:43:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:43:18 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:43:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-69720f87-5516-4d03-bc70-3302a21f5830 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:18 devstack sudo[98873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-69720f87-5516-4d03-bc70-3302a21f5830 1073741824 Sep 05 11:43:18 devstack sudo[98873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:19 devstack sudo[98873]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-69720f87-5516-4d03-bc70-3302a21f5830 1073741824" returned: 0 in 0.475s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-69720f87-5516-4d03-bc70-3302a21f5830 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:19 devstack sudo[98879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-69720f87-5516-4d03-bc70-3302a21f5830 Sep 05 11:43:19 devstack sudo[98879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:19 devstack sudo[98879]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-69720f87-5516-4d03-bc70-3302a21f5830" returned: 0 in 0.377s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:43:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8dd1b99-3880-46dd-8474-e0a1a953140e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69720f87-5516-4d03-bc70-3302a21f5830', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c7ea4b-6b0a-4857-ad8b-7134ef72c48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:19 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] Volume volume-69720f87-5516-4d03-bc70-3302a21f5830 (69720f87-5516-4d03-bc70-3302a21f5830): created successfully Sep 05 11:43:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c7ea4b-6b0a-4857-ad8b-7134ef72c48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] Flow 'volume_create_manager' (8eed23ad-7c96-456d-aeaa-b0b7a1865c92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:43:19 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-43dde177-2974-43c0-bd1a-dbd801b7cc9a tempest-VolumesActionsTest-1505352450 None] Created volume successfully. Sep 05 11:43:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-8840bae2-1dfc-40f2-a3e1-67cad2fbbb50 req-f9e2931c-747d-4794-8588-dbf9e9b7c635 tempest-TestInstancesWithCinderVolumes-422999212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-8840bae2-1dfc-40f2-a3e1-67cad2fbbb50 req-f9e2931c-747d-4794-8588-dbf9e9b7c635 tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-8840bae2-1dfc-40f2-a3e1-67cad2fbbb50 req-f9e2931c-747d-4794-8588-dbf9e9b7c635 tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-8840bae2-1dfc-40f2-a3e1-67cad2fbbb50 req-f9e2931c-747d-4794-8588-dbf9e9b7c635 tempest-TestInstancesWithCinderVolumes-422999212 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32', 'name': 'volume-ae2e6d16-1b0f-460e-b81b-65d5d669a666', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e2c8203d-5cdb-46a5-a683-189ed2268584', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 11:43:19 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-8840bae2-1dfc-40f2-a3e1-67cad2fbbb50 req-f9e2931c-747d-4794-8588-dbf9e9b7c635 tempest-TestInstancesWithCinderVolumes-422999212 None] attachment_update completed successfully. Sep 05 11:43:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2b3457eb-a43a-4281-b2ae-368455d85276 tempest-VolumesActionsTest-1814542065 None] Acquiring lock "cinder-69720f87-5516-4d03-bc70-3302a21f5830-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:43:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2b3457eb-a43a-4281-b2ae-368455d85276 tempest-VolumesActionsTest-1814542065 None] Lock "cinder-69720f87-5516-4d03-bc70-3302a21f5830-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:43:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2b3457eb-a43a-4281-b2ae-368455d85276 tempest-VolumesActionsTest-1814542065 None] Acquiring lock "cinder-quobyte-69720f87-5516-4d03-bc70-3302a21f5830" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:43:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2b3457eb-a43a-4281-b2ae-368455d85276 tempest-VolumesActionsTest-1814542065 None] Lock "cinder-quobyte-69720f87-5516-4d03-bc70-3302a21f5830" acquired by "delete_volume" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:43:20 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[06915bdc-c712-47fc-9f1d-ea50c31270c0]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:43:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2b3457eb-a43a-4281-b2ae-368455d85276 tempest-VolumesActionsTest-1814542065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-69720f87-5516-4d03-bc70-3302a21f5830 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:20 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-69720f87-5516-4d03-bc70-3302a21f5830 Sep 05 11:43:20 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:21 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2b3457eb-a43a-4281-b2ae-368455d85276 tempest-VolumesActionsTest-1814542065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-69720f87-5516-4d03-bc70-3302a21f5830" returned: 0 in 0.416s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2b3457eb-a43a-4281-b2ae-368455d85276 tempest-VolumesActionsTest-1814542065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-69720f87-5516-4d03-bc70-3302a21f5830 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:21 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-69720f87-5516-4d03-bc70-3302a21f5830 Sep 05 11:43:21 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:21 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2b3457eb-a43a-4281-b2ae-368455d85276 tempest-VolumesActionsTest-1814542065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-69720f87-5516-4d03-bc70-3302a21f5830" returned: 0 in 0.272s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2b3457eb-a43a-4281-b2ae-368455d85276 tempest-VolumesActionsTest-1814542065 None] Lock "cinder-quobyte-69720f87-5516-4d03-bc70-3302a21f5830" released by "delete_volume" :: held 0.736s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:43:21 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-2b3457eb-a43a-4281-b2ae-368455d85276 tempest-VolumesActionsTest-1814542065 None] Created reservations ['3038bb35-880a-496b-9c04-eac8e63be097', '6ad9bbb2-1bb3-4473-a76a-88d6601baf0c', '2218bb8a-06c5-4afb-b9e5-31405723d854', 'd1e3b249-b813-4485-b7bd-6bba31c54659'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:43:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2b3457eb-a43a-4281-b2ae-368455d85276 tempest-VolumesActionsTest-1814542065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2b3457eb-a43a-4281-b2ae-368455d85276 tempest-VolumesActionsTest-1814542065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2b3457eb-a43a-4281-b2ae-368455d85276 tempest-VolumesActionsTest-1814542065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:43:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2b3457eb-a43a-4281-b2ae-368455d85276 tempest-VolumesActionsTest-1814542065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:43:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2b3457eb-a43a-4281-b2ae-368455d85276 tempest-VolumesActionsTest-1814542065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2b3457eb-a43a-4281-b2ae-368455d85276 tempest-VolumesActionsTest-1814542065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:21 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:43:21 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:22 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2b3457eb-a43a-4281-b2ae-368455d85276 tempest-VolumesActionsTest-1814542065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.354s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:22 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-2b3457eb-a43a-4281-b2ae-368455d85276 tempest-VolumesActionsTest-1814542065 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:43:22 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2b3457eb-a43a-4281-b2ae-368455d85276 tempest-VolumesActionsTest-1814542065 None] Deleted volume successfully. Sep 05 11:43:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2b3457eb-a43a-4281-b2ae-368455d85276 tempest-VolumesActionsTest-1814542065 None] Lock "cinder-69720f87-5516-4d03-bc70-3302a21f5830-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:43:22 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:43:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] Flow 'volume_create_manager' (8dfa7625-9673-4723-a613-be40ea8dc2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:43:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (449869b1-6528-4423-b08f-25815354e549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (449869b1-6528-4423-b08f-25815354e549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2138177317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd195f24-e155-44bf-a2ec-29516ed4ab22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee54f8ded304d30b3386d225b29cfbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:43:23Z,use_quota=True,user_id='0588a6f622324e0d98d2cf6f87994444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (000fd971-1787-4886-ba8d-90b7a9a324c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (000fd971-1787-4886-ba8d-90b7a9a324c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05274227-7f00-407e-b433-96e6ba7e2eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05274227-7f00-407e-b433-96e6ba7e2eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd195f24-e155-44bf-a2ec-29516ed4ab22', 'volume_name': 'volume-fd195f24-e155-44bf-a2ec-29516ed4ab22', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42b09232-7db1-4294-b202-f403e4aedc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42b09232-7db1-4294-b202-f403e4aedc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ae6a20c-523e-4547-b592-991a3256c0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:23 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] Volume fd195f24-e155-44bf-a2ec-29516ed4ab22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd195f24-e155-44bf-a2ec-29516ed4ab22', 'volume_size': 1} Sep 05 11:43:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2138177317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd195f24-e155-44bf-a2ec-29516ed4ab22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee54f8ded304d30b3386d225b29cfbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:43:23Z,use_quota=True,user_id='0588a6f622324e0d98d2cf6f87994444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:43:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] Creating volume fd195f24-e155-44bf-a2ec-29516ed4ab22 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:43:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:43:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:43:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:43:23 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:43:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-fd195f24-e155-44bf-a2ec-29516ed4ab22 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:23 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-fd195f24-e155-44bf-a2ec-29516ed4ab22 1073741824 Sep 05 11:43:23 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:23 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-fd195f24-e155-44bf-a2ec-29516ed4ab22 1073741824" returned: 0 in 0.546s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-fd195f24-e155-44bf-a2ec-29516ed4ab22 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:23 devstack sudo[99355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-fd195f24-e155-44bf-a2ec-29516ed4ab22 Sep 05 11:43:23 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:23 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-fd195f24-e155-44bf-a2ec-29516ed4ab22" returned: 0 in 0.263s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:43:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ae6a20c-523e-4547-b592-991a3256c0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd195f24-e155-44bf-a2ec-29516ed4ab22', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f534035d-effd-43e4-8437-fc8c2c548b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:24 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] Volume volume-fd195f24-e155-44bf-a2ec-29516ed4ab22 (fd195f24-e155-44bf-a2ec-29516ed4ab22): created successfully Sep 05 11:43:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f534035d-effd-43e4-8437-fc8c2c548b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] Flow 'volume_create_manager' (8dfa7625-9673-4723-a613-be40ea8dc2fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:43:24 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7e6f7adb-4dc6-42cb-b0b1-21f0432a8a26 tempest-VolumesActionsTest-1505352450 None] Created volume successfully. Sep 05 11:43:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ed8618f4-85df-43c2-8425-515c364f6545 tempest-VolumesActionsTest-1814542065 None] Acquiring lock "cinder-fd195f24-e155-44bf-a2ec-29516ed4ab22-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:43:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ed8618f4-85df-43c2-8425-515c364f6545 tempest-VolumesActionsTest-1814542065 None] Lock "cinder-fd195f24-e155-44bf-a2ec-29516ed4ab22-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:43:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ed8618f4-85df-43c2-8425-515c364f6545 tempest-VolumesActionsTest-1814542065 None] Acquiring lock "cinder-quobyte-fd195f24-e155-44bf-a2ec-29516ed4ab22" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:43:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ed8618f4-85df-43c2-8425-515c364f6545 tempest-VolumesActionsTest-1814542065 None] Lock "cinder-quobyte-fd195f24-e155-44bf-a2ec-29516ed4ab22" acquired by "delete_volume" :: waited 0.039s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:43:25 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadcf066-0443-42cd-910e-3e71b1024a51]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:43:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ed8618f4-85df-43c2-8425-515c364f6545 tempest-VolumesActionsTest-1814542065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-fd195f24-e155-44bf-a2ec-29516ed4ab22 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:25 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-fd195f24-e155-44bf-a2ec-29516ed4ab22 Sep 05 11:43:25 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:25 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ed8618f4-85df-43c2-8425-515c364f6545 tempest-VolumesActionsTest-1814542065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-fd195f24-e155-44bf-a2ec-29516ed4ab22" returned: 0 in 0.422s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ed8618f4-85df-43c2-8425-515c364f6545 tempest-VolumesActionsTest-1814542065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-fd195f24-e155-44bf-a2ec-29516ed4ab22 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:25 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-fd195f24-e155-44bf-a2ec-29516ed4ab22 Sep 05 11:43:25 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:26 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ed8618f4-85df-43c2-8425-515c364f6545 tempest-VolumesActionsTest-1814542065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-fd195f24-e155-44bf-a2ec-29516ed4ab22" returned: 0 in 0.281s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ed8618f4-85df-43c2-8425-515c364f6545 tempest-VolumesActionsTest-1814542065 None] Lock "cinder-quobyte-fd195f24-e155-44bf-a2ec-29516ed4ab22" released by "delete_volume" :: held 0.765s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:43:26 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-ed8618f4-85df-43c2-8425-515c364f6545 tempest-VolumesActionsTest-1814542065 None] Created reservations ['bac5d7b8-dc29-475a-8914-eb64a402c9bf', '558bbdf7-29ed-4cd9-a0ab-88d4be40f513', 'c1c4f25b-83b0-4d61-a290-086946262619', '4bf81906-5bfc-44d7-badf-f5963562c1ff'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:43:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ed8618f4-85df-43c2-8425-515c364f6545 tempest-VolumesActionsTest-1814542065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ed8618f4-85df-43c2-8425-515c364f6545 tempest-VolumesActionsTest-1814542065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ed8618f4-85df-43c2-8425-515c364f6545 tempest-VolumesActionsTest-1814542065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:43:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ed8618f4-85df-43c2-8425-515c364f6545 tempest-VolumesActionsTest-1814542065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:43:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ed8618f4-85df-43c2-8425-515c364f6545 tempest-VolumesActionsTest-1814542065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ed8618f4-85df-43c2-8425-515c364f6545 tempest-VolumesActionsTest-1814542065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:26 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:43:26 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:26 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ed8618f4-85df-43c2-8425-515c364f6545 tempest-VolumesActionsTest-1814542065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.426s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:26 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-ed8618f4-85df-43c2-8425-515c364f6545 tempest-VolumesActionsTest-1814542065 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:43:26 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ed8618f4-85df-43c2-8425-515c364f6545 tempest-VolumesActionsTest-1814542065 None] Deleted volume successfully. Sep 05 11:43:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ed8618f4-85df-43c2-8425-515c364f6545 tempest-VolumesActionsTest-1814542065 None] Lock "cinder-fd195f24-e155-44bf-a2ec-29516ed4ab22-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:43:27 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:43:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] Flow 'volume_create_manager' (9703912b-a34b-4dc1-a54a-d7b7ae1bac56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:43:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6cfc5b1-851d-4ed4-bf88-7e97e991aad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6cfc5b1-851d-4ed4-bf88-7e97e991aad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1232520666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9665ea21-55f6-4f78-a736-654deb8ad38c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee54f8ded304d30b3386d225b29cfbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:43:27Z,use_quota=True,user_id='0588a6f622324e0d98d2cf6f87994444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6c818f3-e37c-498c-88c1-c9bd13e2eeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6c818f3-e37c-498c-88c1-c9bd13e2eeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab81640-9569-4764-8405-6118819f77d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab81640-9569-4764-8405-6118819f77d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9665ea21-55f6-4f78-a736-654deb8ad38c', 'volume_name': 'volume-9665ea21-55f6-4f78-a736-654deb8ad38c', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b22df6e2-21f3-4a54-82dd-f606c97512f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b22df6e2-21f3-4a54-82dd-f606c97512f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c315960c-9dad-4593-ac39-f6c8ca54a00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:27 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] Volume 9665ea21-55f6-4f78-a736-654deb8ad38c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9665ea21-55f6-4f78-a736-654deb8ad38c', 'volume_size': 1} Sep 05 11:43:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1232520666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9665ea21-55f6-4f78-a736-654deb8ad38c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee54f8ded304d30b3386d225b29cfbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:43:27Z,use_quota=True,user_id='0588a6f622324e0d98d2cf6f87994444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:43:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] Creating volume 9665ea21-55f6-4f78-a736-654deb8ad38c {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:43:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:43:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:43:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:43:27 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:43:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9665ea21-55f6-4f78-a736-654deb8ad38c 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:27 devstack sudo[99374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9665ea21-55f6-4f78-a736-654deb8ad38c 1073741824 Sep 05 11:43:27 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:28 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9665ea21-55f6-4f78-a736-654deb8ad38c 1073741824" returned: 0 in 0.666s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9665ea21-55f6-4f78-a736-654deb8ad38c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:28 devstack sudo[99381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9665ea21-55f6-4f78-a736-654deb8ad38c Sep 05 11:43:28 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:28 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9665ea21-55f6-4f78-a736-654deb8ad38c" returned: 0 in 0.353s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:43:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c315960c-9dad-4593-ac39-f6c8ca54a00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9665ea21-55f6-4f78-a736-654deb8ad38c', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c34ad27b-0de3-42c1-8860-7fcad89bb295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:28 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] Volume volume-9665ea21-55f6-4f78-a736-654deb8ad38c (9665ea21-55f6-4f78-a736-654deb8ad38c): created successfully Sep 05 11:43:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c34ad27b-0de3-42c1-8860-7fcad89bb295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] Flow 'volume_create_manager' (9703912b-a34b-4dc1-a54a-d7b7ae1bac56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:43:28 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-bca1986d-1ef6-4e9c-9938-95adda697261 tempest-VolumesActionsTest-1505352450 None] Created volume successfully. Sep 05 11:43:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e4c6901e-215c-4162-98a6-eb36757dff31 tempest-VolumesActionsTest-1814542065 None] Acquiring lock "cinder-9665ea21-55f6-4f78-a736-654deb8ad38c-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:43:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e4c6901e-215c-4162-98a6-eb36757dff31 tempest-VolumesActionsTest-1814542065 None] Lock "cinder-9665ea21-55f6-4f78-a736-654deb8ad38c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:43:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e4c6901e-215c-4162-98a6-eb36757dff31 tempest-VolumesActionsTest-1814542065 None] Acquiring lock "cinder-quobyte-9665ea21-55f6-4f78-a736-654deb8ad38c" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:43:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e4c6901e-215c-4162-98a6-eb36757dff31 tempest-VolumesActionsTest-1814542065 None] Lock "cinder-quobyte-9665ea21-55f6-4f78-a736-654deb8ad38c" acquired by "delete_volume" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:43:29 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d33198b-da45-423b-a8b9-503df229632d]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:43:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e4c6901e-215c-4162-98a6-eb36757dff31 tempest-VolumesActionsTest-1814542065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9665ea21-55f6-4f78-a736-654deb8ad38c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:30 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9665ea21-55f6-4f78-a736-654deb8ad38c Sep 05 11:43:30 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:30 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e4c6901e-215c-4162-98a6-eb36757dff31 tempest-VolumesActionsTest-1814542065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9665ea21-55f6-4f78-a736-654deb8ad38c" returned: 0 in 0.483s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e4c6901e-215c-4162-98a6-eb36757dff31 tempest-VolumesActionsTest-1814542065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9665ea21-55f6-4f78-a736-654deb8ad38c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:30 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9665ea21-55f6-4f78-a736-654deb8ad38c Sep 05 11:43:30 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:30 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e4c6901e-215c-4162-98a6-eb36757dff31 tempest-VolumesActionsTest-1814542065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9665ea21-55f6-4f78-a736-654deb8ad38c" returned: 0 in 0.297s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e4c6901e-215c-4162-98a6-eb36757dff31 tempest-VolumesActionsTest-1814542065 None] Lock "cinder-quobyte-9665ea21-55f6-4f78-a736-654deb8ad38c" released by "delete_volume" :: held 0.851s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:43:30 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-e4c6901e-215c-4162-98a6-eb36757dff31 tempest-VolumesActionsTest-1814542065 None] Created reservations ['7944525b-f935-404f-8937-bfaed8445f95', 'fe99f19d-5d84-47fc-95d8-5e71a4ccf3a9', '8ec78948-81b3-4350-a22f-fc5dd1d20b79', 'ac8c77a4-8ec9-4504-9c6d-c62fb4e2d79b'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:43:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e4c6901e-215c-4162-98a6-eb36757dff31 tempest-VolumesActionsTest-1814542065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e4c6901e-215c-4162-98a6-eb36757dff31 tempest-VolumesActionsTest-1814542065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e4c6901e-215c-4162-98a6-eb36757dff31 tempest-VolumesActionsTest-1814542065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:43:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e4c6901e-215c-4162-98a6-eb36757dff31 tempest-VolumesActionsTest-1814542065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:43:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e4c6901e-215c-4162-98a6-eb36757dff31 tempest-VolumesActionsTest-1814542065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e4c6901e-215c-4162-98a6-eb36757dff31 tempest-VolumesActionsTest-1814542065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:31 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:43:31 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:31 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e4c6901e-215c-4162-98a6-eb36757dff31 tempest-VolumesActionsTest-1814542065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.425s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:31 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-e4c6901e-215c-4162-98a6-eb36757dff31 tempest-VolumesActionsTest-1814542065 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:43:31 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e4c6901e-215c-4162-98a6-eb36757dff31 tempest-VolumesActionsTest-1814542065 None] Deleted volume successfully. Sep 05 11:43:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e4c6901e-215c-4162-98a6-eb36757dff31 tempest-VolumesActionsTest-1814542065 None] Lock "cinder-9665ea21-55f6-4f78-a736-654deb8ad38c-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:43:31 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:43:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] Flow 'volume_create_manager' (0e8aaa28-ed3b-48ab-ac87-272dcce744b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:43:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc259649-6f71-46df-84fc-6ca420bb9293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc259649-6f71-46df-84fc-6ca420bb9293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2064862939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b17e1e27-ffde-4dd4-934d-5e1a2f77426a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee54f8ded304d30b3386d225b29cfbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:43:32Z,use_quota=True,user_id='0588a6f622324e0d98d2cf6f87994444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e33ea753-6379-4252-9be9-d8f042afcb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e33ea753-6379-4252-9be9-d8f042afcb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25a5865a-0efb-48fb-9ec6-ad304da0aea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25a5865a-0efb-48fb-9ec6-ad304da0aea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b17e1e27-ffde-4dd4-934d-5e1a2f77426a', 'volume_name': 'volume-b17e1e27-ffde-4dd4-934d-5e1a2f77426a', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (513be15d-3ce0-4fad-8ea3-48c3ed181c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (513be15d-3ce0-4fad-8ea3-48c3ed181c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f160f6d-a9f0-47e3-8cdf-1d72129d8367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:31 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] Volume b17e1e27-ffde-4dd4-934d-5e1a2f77426a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b17e1e27-ffde-4dd4-934d-5e1a2f77426a', 'volume_size': 1} Sep 05 11:43:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2064862939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b17e1e27-ffde-4dd4-934d-5e1a2f77426a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee54f8ded304d30b3386d225b29cfbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:43:32Z,use_quota=True,user_id='0588a6f622324e0d98d2cf6f87994444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:43:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] Creating volume b17e1e27-ffde-4dd4-934d-5e1a2f77426a {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:43:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:43:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:43:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:43:31 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:43:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b17e1e27-ffde-4dd4-934d-5e1a2f77426a 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:31 devstack sudo[99432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b17e1e27-ffde-4dd4-934d-5e1a2f77426a 1073741824 Sep 05 11:43:31 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:43:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:43:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:43:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:32 devstack sudo[99438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:43:32 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:32 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b17e1e27-ffde-4dd4-934d-5e1a2f77426a 1073741824" returned: 0 in 0.783s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:32 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.404s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:32 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:43:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:43:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread count: 28 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 11:43:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread info: [<_MainThread(MainThread, started 131707869511808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 11:43:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b17e1e27-ffde-4dd4-934d-5e1a2f77426a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:32 devstack sudo[99443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b17e1e27-ffde-4dd4-934d-5e1a2f77426a Sep 05 11:43:32 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:33 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b17e1e27-ffde-4dd4-934d-5e1a2f77426a" returned: 0 in 0.319s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:43:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f160f6d-a9f0-47e3-8cdf-1d72129d8367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b17e1e27-ffde-4dd4-934d-5e1a2f77426a', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e834cd20-bad8-4bec-9c8c-59eff1191744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:33 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] Volume volume-b17e1e27-ffde-4dd4-934d-5e1a2f77426a (b17e1e27-ffde-4dd4-934d-5e1a2f77426a): created successfully Sep 05 11:43:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e834cd20-bad8-4bec-9c8c-59eff1191744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] Flow 'volume_create_manager' (0e8aaa28-ed3b-48ab-ac87-272dcce744b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:43:33 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-9f443665-4d38-4cfa-887c-1eb2642c6c67 tempest-VolumesActionsTest-1505352450 None] Created volume successfully. Sep 05 11:43:33 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a0ecbd05-276c-4e58-ab3c-339475f9c9b2 tempest-VolumesActionsTest-1814542065 None] Acquiring lock "cinder-b17e1e27-ffde-4dd4-934d-5e1a2f77426a-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:43:33 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a0ecbd05-276c-4e58-ab3c-339475f9c9b2 tempest-VolumesActionsTest-1814542065 None] Lock "cinder-b17e1e27-ffde-4dd4-934d-5e1a2f77426a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:43:33 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a0ecbd05-276c-4e58-ab3c-339475f9c9b2 tempest-VolumesActionsTest-1814542065 None] Acquiring lock "cinder-quobyte-b17e1e27-ffde-4dd4-934d-5e1a2f77426a" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:43:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a0ecbd05-276c-4e58-ab3c-339475f9c9b2 tempest-VolumesActionsTest-1814542065 None] Lock "cinder-quobyte-b17e1e27-ffde-4dd4-934d-5e1a2f77426a" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:43:34 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4327feab-6364-4b49-b5f0-a0a0ea430ce4]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:43:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a0ecbd05-276c-4e58-ab3c-339475f9c9b2 tempest-VolumesActionsTest-1814542065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b17e1e27-ffde-4dd4-934d-5e1a2f77426a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:34 devstack sudo[99446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b17e1e27-ffde-4dd4-934d-5e1a2f77426a Sep 05 11:43:34 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:34 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a0ecbd05-276c-4e58-ab3c-339475f9c9b2 tempest-VolumesActionsTest-1814542065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b17e1e27-ffde-4dd4-934d-5e1a2f77426a" returned: 0 in 0.399s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a0ecbd05-276c-4e58-ab3c-339475f9c9b2 tempest-VolumesActionsTest-1814542065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b17e1e27-ffde-4dd4-934d-5e1a2f77426a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:34 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b17e1e27-ffde-4dd4-934d-5e1a2f77426a Sep 05 11:43:34 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:34 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a0ecbd05-276c-4e58-ab3c-339475f9c9b2 tempest-VolumesActionsTest-1814542065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b17e1e27-ffde-4dd4-934d-5e1a2f77426a" returned: 0 in 0.260s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a0ecbd05-276c-4e58-ab3c-339475f9c9b2 tempest-VolumesActionsTest-1814542065 None] Lock "cinder-quobyte-b17e1e27-ffde-4dd4-934d-5e1a2f77426a" released by "delete_volume" :: held 0.702s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:43:34 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-a0ecbd05-276c-4e58-ab3c-339475f9c9b2 tempest-VolumesActionsTest-1814542065 None] Created reservations ['066790a6-45e0-441f-977f-909ebb53d45a', 'f3da6765-4167-41b3-8758-e493ec2fc8b2', '91355b93-e23f-41d4-ab72-48edf842f126', '342f1cd2-9097-44cc-b5ce-1f0dffb02e64'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:43:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a0ecbd05-276c-4e58-ab3c-339475f9c9b2 tempest-VolumesActionsTest-1814542065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a0ecbd05-276c-4e58-ab3c-339475f9c9b2 tempest-VolumesActionsTest-1814542065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:34 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a0ecbd05-276c-4e58-ab3c-339475f9c9b2 tempest-VolumesActionsTest-1814542065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:43:34 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a0ecbd05-276c-4e58-ab3c-339475f9c9b2 tempest-VolumesActionsTest-1814542065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:43:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a0ecbd05-276c-4e58-ab3c-339475f9c9b2 tempest-VolumesActionsTest-1814542065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a0ecbd05-276c-4e58-ab3c-339475f9c9b2 tempest-VolumesActionsTest-1814542065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:34 devstack sudo[99454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:43:34 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:35 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a0ecbd05-276c-4e58-ab3c-339475f9c9b2 tempest-VolumesActionsTest-1814542065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.301s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:35 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-a0ecbd05-276c-4e58-ab3c-339475f9c9b2 tempest-VolumesActionsTest-1814542065 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:43:35 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a0ecbd05-276c-4e58-ab3c-339475f9c9b2 tempest-VolumesActionsTest-1814542065 None] Deleted volume successfully. Sep 05 11:43:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a0ecbd05-276c-4e58-ab3c-339475f9c9b2 tempest-VolumesActionsTest-1814542065 None] Lock "cinder-b17e1e27-ffde-4dd4-934d-5e1a2f77426a-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:43:35 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:43:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] Flow 'volume_create_manager' (f6e96412-a0b5-4511-a606-c5bc5ad94215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:43:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (617939cc-a5d7-487e-9ab7-622f03e4e6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (617939cc-a5d7-487e-9ab7-622f03e4e6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1729590674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6340f078-d471-40af-be9b-86e2036486d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee54f8ded304d30b3386d225b29cfbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:43:36Z,use_quota=True,user_id='0588a6f622324e0d98d2cf6f87994444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38e06bb7-083d-4962-8fc9-d1a40225858e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38e06bb7-083d-4962-8fc9-d1a40225858e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0da25b7-1c92-477c-ab20-6de46cf3ddd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0da25b7-1c92-477c-ab20-6de46cf3ddd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6340f078-d471-40af-be9b-86e2036486d4', 'volume_name': 'volume-6340f078-d471-40af-be9b-86e2036486d4', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9df48c7-572c-4a51-9a80-2d14ac1bbae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9df48c7-572c-4a51-9a80-2d14ac1bbae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b14af66e-0373-44ce-b7f8-61394ef82cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:35 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] Volume 6340f078-d471-40af-be9b-86e2036486d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6340f078-d471-40af-be9b-86e2036486d4', 'volume_size': 1} Sep 05 11:43:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1729590674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6340f078-d471-40af-be9b-86e2036486d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee54f8ded304d30b3386d225b29cfbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:43:36Z,use_quota=True,user_id='0588a6f622324e0d98d2cf6f87994444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:43:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] Creating volume 6340f078-d471-40af-be9b-86e2036486d4 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:43:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:43:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:43:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:43:35 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:43:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6340f078-d471-40af-be9b-86e2036486d4 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:35 devstack sudo[99457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6340f078-d471-40af-be9b-86e2036486d4 1073741824 Sep 05 11:43:35 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:36 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6340f078-d471-40af-be9b-86e2036486d4 1073741824" returned: 0 in 0.470s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6340f078-d471-40af-be9b-86e2036486d4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:36 devstack sudo[99462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6340f078-d471-40af-be9b-86e2036486d4 Sep 05 11:43:36 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:36 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6340f078-d471-40af-be9b-86e2036486d4" returned: 0 in 0.260s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:43:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b14af66e-0373-44ce-b7f8-61394ef82cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6340f078-d471-40af-be9b-86e2036486d4', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86407cf9-0243-403f-8b20-9c990b2269d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:36 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] Volume volume-6340f078-d471-40af-be9b-86e2036486d4 (6340f078-d471-40af-be9b-86e2036486d4): created successfully Sep 05 11:43:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86407cf9-0243-403f-8b20-9c990b2269d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] Flow 'volume_create_manager' (f6e96412-a0b5-4511-a606-c5bc5ad94215) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:43:36 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-cbaa786e-4a4a-478c-b2c1-ea4a0f959ab4 tempest-VolumesActionsTest-1505352450 None] Created volume successfully. Sep 05 11:43:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0bcffbc9-0df0-441e-bb4b-c9f4647b1a55 tempest-VolumesActionsTest-1505352450 None] Acquiring lock "cinder-6340f078-d471-40af-be9b-86e2036486d4-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:43:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0bcffbc9-0df0-441e-bb4b-c9f4647b1a55 tempest-VolumesActionsTest-1505352450 None] Lock "cinder-6340f078-d471-40af-be9b-86e2036486d4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:43:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0bcffbc9-0df0-441e-bb4b-c9f4647b1a55 tempest-VolumesActionsTest-1505352450 None] Acquiring lock "cinder-quobyte-6340f078-d471-40af-be9b-86e2036486d4" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:43:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0bcffbc9-0df0-441e-bb4b-c9f4647b1a55 tempest-VolumesActionsTest-1505352450 None] Lock "cinder-quobyte-6340f078-d471-40af-be9b-86e2036486d4" acquired by "delete_volume" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:43:38 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3dfb97-1309-4bce-b7d2-7d4d7c710a83]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:43:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0bcffbc9-0df0-441e-bb4b-c9f4647b1a55 tempest-VolumesActionsTest-1505352450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6340f078-d471-40af-be9b-86e2036486d4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:38 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6340f078-d471-40af-be9b-86e2036486d4 Sep 05 11:43:38 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:38 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0bcffbc9-0df0-441e-bb4b-c9f4647b1a55 tempest-VolumesActionsTest-1505352450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6340f078-d471-40af-be9b-86e2036486d4" returned: 0 in 0.413s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0bcffbc9-0df0-441e-bb4b-c9f4647b1a55 tempest-VolumesActionsTest-1505352450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6340f078-d471-40af-be9b-86e2036486d4 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:38 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6340f078-d471-40af-be9b-86e2036486d4 Sep 05 11:43:38 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:39 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0bcffbc9-0df0-441e-bb4b-c9f4647b1a55 tempest-VolumesActionsTest-1505352450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6340f078-d471-40af-be9b-86e2036486d4" returned: 0 in 0.290s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0bcffbc9-0df0-441e-bb4b-c9f4647b1a55 tempest-VolumesActionsTest-1505352450 None] Lock "cinder-quobyte-6340f078-d471-40af-be9b-86e2036486d4" released by "delete_volume" :: held 0.759s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:43:39 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-0bcffbc9-0df0-441e-bb4b-c9f4647b1a55 tempest-VolumesActionsTest-1505352450 None] Created reservations ['4b35895b-90d8-46e2-9e01-d348fcbcf6f4', 'dcda1b4b-345f-4719-b486-8d911099113d', '21f32335-8ec2-45df-b067-061cbc1fe7e7', 'bbcc0181-08ea-496a-b750-4ab36bdd4d9f'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:43:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0bcffbc9-0df0-441e-bb4b-c9f4647b1a55 tempest-VolumesActionsTest-1505352450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0bcffbc9-0df0-441e-bb4b-c9f4647b1a55 tempest-VolumesActionsTest-1505352450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0bcffbc9-0df0-441e-bb4b-c9f4647b1a55 tempest-VolumesActionsTest-1505352450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:43:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0bcffbc9-0df0-441e-bb4b-c9f4647b1a55 tempest-VolumesActionsTest-1505352450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:43:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0bcffbc9-0df0-441e-bb4b-c9f4647b1a55 tempest-VolumesActionsTest-1505352450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0bcffbc9-0df0-441e-bb4b-c9f4647b1a55 tempest-VolumesActionsTest-1505352450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:39 devstack sudo[99476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:43:39 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:39 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0bcffbc9-0df0-441e-bb4b-c9f4647b1a55 tempest-VolumesActionsTest-1505352450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.294s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:39 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-0bcffbc9-0df0-441e-bb4b-c9f4647b1a55 tempest-VolumesActionsTest-1505352450 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:43:39 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-0bcffbc9-0df0-441e-bb4b-c9f4647b1a55 tempest-VolumesActionsTest-1505352450 None] Deleted volume successfully. Sep 05 11:43:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-0bcffbc9-0df0-441e-bb4b-c9f4647b1a55 tempest-VolumesActionsTest-1505352450 None] Lock "cinder-6340f078-d471-40af-be9b-86e2036486d4-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:43:49 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=130,cinder:SELECT=96,cinder:INSERT=30,cinder:DELETE=12 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:43:49 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=96,cinder:INSERT=34,cinder:UPDATE=122,cinder:DELETE=11 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:43:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-e3e6cf84-0bab-4cd7-8cf4-8c2ca34f7a35 req-8d589976-415d-4c50-8778-e4439fd66c1a tempest-TestInstancesWithCinderVolumes-422999212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-e3e6cf84-0bab-4cd7-8cf4-8c2ca34f7a35 req-8d589976-415d-4c50-8778-e4439fd66c1a tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-e3e6cf84-0bab-4cd7-8cf4-8c2ca34f7a35 req-8d589976-415d-4c50-8778-e4439fd66c1a tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-e3e6cf84-0bab-4cd7-8cf4-8c2ca34f7a35 req-8d589976-415d-4c50-8778-e4439fd66c1a tempest-TestInstancesWithCinderVolumes-422999212 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32', 'name': 'volume-d1a384ec-faa0-48f6-ba30-b8b54b43c0f8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f9ab29f-5b7a-4470-bcfb-79af940d0202', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 11:43:52 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-e3e6cf84-0bab-4cd7-8cf4-8c2ca34f7a35 req-8d589976-415d-4c50-8778-e4439fd66c1a tempest-TestInstancesWithCinderVolumes-422999212 None] attachment_update completed successfully. Sep 05 11:43:53 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:43:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] Flow 'volume_create_manager' (ffbb0878-258b-4f8b-8846-a43646442634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:43:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (903cf5a2-7c1e-4b46-ba9d-9b7bea5d6661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (903cf5a2-7c1e-4b46-ba9d-9b7bea5d6661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1153705440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd88b0ca-7039-4215-98a0-33b0c1c6284f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4c74b9d0f8741e9bd678a90ae5b6261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:43:53Z,use_quota=True,user_id='93a51d452bf64dc1a93bc3132d47f3a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f86e8b0-4acc-43fa-bbdb-90fb658a5bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f86e8b0-4acc-43fa-bbdb-90fb658a5bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa22bd4-01e9-4a48-b990-d0b9fa5e5b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa22bd4-01e9-4a48-b990-d0b9fa5e5b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd88b0ca-7039-4215-98a0-33b0c1c6284f', 'volume_name': 'volume-dd88b0ca-7039-4215-98a0-33b0c1c6284f', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (515bcae0-a457-46e0-a6c3-d761d6d40b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (515bcae0-a457-46e0-a6c3-d761d6d40b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6789ecf-37c9-4b84-84c5-33f51204aa75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:53 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] Volume dd88b0ca-7039-4215-98a0-33b0c1c6284f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd88b0ca-7039-4215-98a0-33b0c1c6284f', 'volume_size': 1} Sep 05 11:43:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1153705440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd88b0ca-7039-4215-98a0-33b0c1c6284f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4c74b9d0f8741e9bd678a90ae5b6261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:43:53Z,use_quota=True,user_id='93a51d452bf64dc1a93bc3132d47f3a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:43:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] Creating volume dd88b0ca-7039-4215-98a0-33b0c1c6284f {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:43:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:43:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:43:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:43:53 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:43:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dd88b0ca-7039-4215-98a0-33b0c1c6284f 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:53 devstack sudo[99547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dd88b0ca-7039-4215-98a0-33b0c1c6284f 1073741824 Sep 05 11:43:53 devstack sudo[99547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:54 devstack sudo[99547]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dd88b0ca-7039-4215-98a0-33b0c1c6284f 1073741824" returned: 0 in 0.443s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dd88b0ca-7039-4215-98a0-33b0c1c6284f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:54 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dd88b0ca-7039-4215-98a0-33b0c1c6284f Sep 05 11:43:54 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:54 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dd88b0ca-7039-4215-98a0-33b0c1c6284f" returned: 0 in 0.272s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:43:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6789ecf-37c9-4b84-84c5-33f51204aa75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd88b0ca-7039-4215-98a0-33b0c1c6284f', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5649856d-737d-46f9-86b1-563709d083ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:54 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] Volume volume-dd88b0ca-7039-4215-98a0-33b0c1c6284f (dd88b0ca-7039-4215-98a0-33b0c1c6284f): created successfully Sep 05 11:43:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5649856d-737d-46f9-86b1-563709d083ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:54 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] Flow 'volume_create_manager' (ffbb0878-258b-4f8b-8846-a43646442634) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:43:54 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-8b550755-887a-4fff-a0e8-a1e36b4eb126 tempest-VolumesTransfersV357Test-105127878 None] Created volume successfully. Sep 05 11:43:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-3d6c60ff-7b6c-4b25-a662-114e9050cf27 req-af476137-2d1b-489b-bc52-170f87a2e40a tempest-TestInstancesWithCinderVolumes-422999212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-3d6c60ff-7b6c-4b25-a662-114e9050cf27 req-af476137-2d1b-489b-bc52-170f87a2e40a tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-3d6c60ff-7b6c-4b25-a662-114e9050cf27 req-af476137-2d1b-489b-bc52-170f87a2e40a tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-3d6c60ff-7b6c-4b25-a662-114e9050cf27 req-af476137-2d1b-489b-bc52-170f87a2e40a tempest-TestInstancesWithCinderVolumes-422999212 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32', 'name': 'volume-e8f8b484-5f65-4e75-b0f9-dfbf50d8a64b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43da63b4-ebbe-4959-9fc7-8939b1ce4e94', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 11:43:55 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-3d6c60ff-7b6c-4b25-a662-114e9050cf27 req-af476137-2d1b-489b-bc52-170f87a2e40a tempest-TestInstancesWithCinderVolumes-422999212 None] attachment_update completed successfully. Sep 05 11:43:55 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d8fbdd8e-92d3-4915-8d3d-6063ba2b6eb4 tempest-VolumesTransfersV357Test-1956956909 None] Transfer volume completed successfully. Sep 05 11:43:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-17fddf85-55f2-434e-8681-239d12201e4a tempest-VolumesTransfersV357Test-1825161470 None] Acquiring lock "cinder-dd88b0ca-7039-4215-98a0-33b0c1c6284f-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:43:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-17fddf85-55f2-434e-8681-239d12201e4a tempest-VolumesTransfersV357Test-1825161470 None] Lock "cinder-dd88b0ca-7039-4215-98a0-33b0c1c6284f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:43:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-17fddf85-55f2-434e-8681-239d12201e4a tempest-VolumesTransfersV357Test-1825161470 None] Acquiring lock "cinder-quobyte-dd88b0ca-7039-4215-98a0-33b0c1c6284f" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:43:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-17fddf85-55f2-434e-8681-239d12201e4a tempest-VolumesTransfersV357Test-1825161470 None] Lock "cinder-quobyte-dd88b0ca-7039-4215-98a0-33b0c1c6284f" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:43:56 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[607504d4-844d-4722-8699-26a661cb1a4b]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:43:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-17fddf85-55f2-434e-8681-239d12201e4a tempest-VolumesTransfersV357Test-1825161470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dd88b0ca-7039-4215-98a0-33b0c1c6284f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:56 devstack sudo[99578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dd88b0ca-7039-4215-98a0-33b0c1c6284f Sep 05 11:43:56 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:56 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-17fddf85-55f2-434e-8681-239d12201e4a tempest-VolumesTransfersV357Test-1825161470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dd88b0ca-7039-4215-98a0-33b0c1c6284f" returned: 0 in 0.391s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-17fddf85-55f2-434e-8681-239d12201e4a tempest-VolumesTransfersV357Test-1825161470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dd88b0ca-7039-4215-98a0-33b0c1c6284f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:56 devstack sudo[99589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dd88b0ca-7039-4215-98a0-33b0c1c6284f Sep 05 11:43:56 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:56 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-17fddf85-55f2-434e-8681-239d12201e4a tempest-VolumesTransfersV357Test-1825161470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dd88b0ca-7039-4215-98a0-33b0c1c6284f" returned: 0 in 0.264s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-17fddf85-55f2-434e-8681-239d12201e4a tempest-VolumesTransfersV357Test-1825161470 None] Lock "cinder-quobyte-dd88b0ca-7039-4215-98a0-33b0c1c6284f" released by "delete_volume" :: held 0.712s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:43:56 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-17fddf85-55f2-434e-8681-239d12201e4a tempest-VolumesTransfersV357Test-1825161470 None] Created reservations ['55a5882a-99f7-4ba8-8ddb-a3f937db8fc7', 'df636f72-ea5c-4232-9c04-419900c2f505', '1a9d1ad8-b93a-47b1-84b6-021fb225a8ff', '26aa40a4-7ee2-46d2-84f6-f0eae87c6dfd'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:43:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-17fddf85-55f2-434e-8681-239d12201e4a tempest-VolumesTransfersV357Test-1825161470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-17fddf85-55f2-434e-8681-239d12201e4a tempest-VolumesTransfersV357Test-1825161470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-17fddf85-55f2-434e-8681-239d12201e4a tempest-VolumesTransfersV357Test-1825161470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:43:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-17fddf85-55f2-434e-8681-239d12201e4a tempest-VolumesTransfersV357Test-1825161470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:43:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-17fddf85-55f2-434e-8681-239d12201e4a tempest-VolumesTransfersV357Test-1825161470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-17fddf85-55f2-434e-8681-239d12201e4a tempest-VolumesTransfersV357Test-1825161470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:56 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:43:56 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:57 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-17fddf85-55f2-434e-8681-239d12201e4a tempest-VolumesTransfersV357Test-1825161470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.272s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:57 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-17fddf85-55f2-434e-8681-239d12201e4a tempest-VolumesTransfersV357Test-1825161470 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:43:57 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-17fddf85-55f2-434e-8681-239d12201e4a tempest-VolumesTransfersV357Test-1825161470 None] Deleted volume successfully. Sep 05 11:43:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-17fddf85-55f2-434e-8681-239d12201e4a tempest-VolumesTransfersV357Test-1825161470 None] Lock "cinder-dd88b0ca-7039-4215-98a0-33b0c1c6284f-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:43:57 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:43:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] Flow 'volume_create_manager' (f6152761-084f-40a1-b910-fb48a5db3656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:43:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (410e1761-6b9a-48f9-8898-1f5c56f554c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (410e1761-6b9a-48f9-8898-1f5c56f554c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1422519507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0211992-98fa-4d57-9929-4654d57c5e1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4c74b9d0f8741e9bd678a90ae5b6261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:43:58Z,use_quota=True,user_id='93a51d452bf64dc1a93bc3132d47f3a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a96d681-9dd4-4c1c-97ba-3b5c143b5b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a96d681-9dd4-4c1c-97ba-3b5c143b5b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73bbc057-cf27-4862-a1fa-94ad922d8f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73bbc057-cf27-4862-a1fa-94ad922d8f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0211992-98fa-4d57-9929-4654d57c5e1b', 'volume_name': 'volume-d0211992-98fa-4d57-9929-4654d57c5e1b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ccaec3b-3336-4b3e-a649-ae7135ef3fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ccaec3b-3336-4b3e-a649-ae7135ef3fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f838e5b-e1c1-4ee6-affd-478790ba17d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:57 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] Volume d0211992-98fa-4d57-9929-4654d57c5e1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0211992-98fa-4d57-9929-4654d57c5e1b', 'volume_size': 1} Sep 05 11:43:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1422519507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0211992-98fa-4d57-9929-4654d57c5e1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4c74b9d0f8741e9bd678a90ae5b6261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:43:58Z,use_quota=True,user_id='93a51d452bf64dc1a93bc3132d47f3a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:43:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] Creating volume d0211992-98fa-4d57-9929-4654d57c5e1b {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:43:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:43:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:43:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:43:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:43:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:43:57 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:43:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d0211992-98fa-4d57-9929-4654d57c5e1b 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:57 devstack sudo[99595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d0211992-98fa-4d57-9929-4654d57c5e1b 1073741824 Sep 05 11:43:57 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:58 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d0211992-98fa-4d57-9929-4654d57c5e1b 1073741824" returned: 0 in 0.471s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d0211992-98fa-4d57-9929-4654d57c5e1b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:43:58 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d0211992-98fa-4d57-9929-4654d57c5e1b Sep 05 11:43:58 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:43:58 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Sep 05 11:43:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d0211992-98fa-4d57-9929-4654d57c5e1b" returned: 0 in 0.247s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:43:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:43:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:43:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f838e5b-e1c1-4ee6-affd-478790ba17d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0211992-98fa-4d57-9929-4654d57c5e1b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa491253-0920-4302-9c11-befefbd87cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:43:58 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] Volume volume-d0211992-98fa-4d57-9929-4654d57c5e1b (d0211992-98fa-4d57-9929-4654d57c5e1b): created successfully Sep 05 11:43:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa491253-0920-4302-9c11-befefbd87cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:43:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] Flow 'volume_create_manager' (f6152761-084f-40a1-b910-fb48a5db3656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:43:58 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-fecb95ac-c349-4651-8173-bfd795ce6faf tempest-VolumesTransfersV357Test-105127878 None] Created volume successfully. Sep 05 11:43:59 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-28f440c7-0546-4ba4-8787-530aa11d097b req-b234d97d-4a1b-49b6-8451-0009486a6642 tempest-TestInstancesWithCinderVolumes-422999212 None] Terminate volume connection completed successfully. Sep 05 11:43:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-28f440c7-0546-4ba4-8787-530aa11d097b req-b234d97d-4a1b-49b6-8451-0009486a6642 tempest-TestInstancesWithCinderVolumes-422999212 None] Deleting attachment 5f9ab29f-5b7a-4470-bcfb-79af940d0202. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 11:44:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-84133938-27bf-403c-b93f-ff51d7f335f3 tempest-VolumesTransfersV357Test-1825161470 None] Acquiring lock "cinder-d0211992-98fa-4d57-9929-4654d57c5e1b-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:44:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-84133938-27bf-403c-b93f-ff51d7f335f3 tempest-VolumesTransfersV357Test-1825161470 None] Lock "cinder-d0211992-98fa-4d57-9929-4654d57c5e1b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:44:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-84133938-27bf-403c-b93f-ff51d7f335f3 tempest-VolumesTransfersV357Test-1825161470 None] Acquiring lock "cinder-quobyte-d0211992-98fa-4d57-9929-4654d57c5e1b" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:44:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-84133938-27bf-403c-b93f-ff51d7f335f3 tempest-VolumesTransfersV357Test-1825161470 None] Lock "cinder-quobyte-d0211992-98fa-4d57-9929-4654d57c5e1b" acquired by "delete_volume" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:44:00 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[9527778d-9594-40ad-b8a5-cdd26d2a421f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:44:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-84133938-27bf-403c-b93f-ff51d7f335f3 tempest-VolumesTransfersV357Test-1825161470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d0211992-98fa-4d57-9929-4654d57c5e1b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:00 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d0211992-98fa-4d57-9929-4654d57c5e1b Sep 05 11:44:00 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-873db099-2a66-42cb-bdd7-c69e1a571939 tempest-TestInstancesWithCinderVolumes-422999212 None] Acquiring lock "cinder-d1a384ec-faa0-48f6-ba30-b8b54b43c0f8-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:44:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-873db099-2a66-42cb-bdd7-c69e1a571939 tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "cinder-d1a384ec-faa0-48f6-ba30-b8b54b43c0f8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:44:00 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-acd0a393-13ca-4fc5-bfab-08c4361b3367 req-f0092ac5-97c2-4b89-b8d7-aada09ed7433 tempest-AttachVolumeTestJSON-1706745870 None] Terminate volume connection completed successfully. Sep 05 11:44:00 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-acd0a393-13ca-4fc5-bfab-08c4361b3367 req-f0092ac5-97c2-4b89-b8d7-aada09ed7433 tempest-AttachVolumeTestJSON-1706745870 None] Deleting attachment e61507fa-6559-41a8-a710-57c80ef47a2c. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 11:44:00 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-84133938-27bf-403c-b93f-ff51d7f335f3 tempest-VolumesTransfersV357Test-1825161470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d0211992-98fa-4d57-9929-4654d57c5e1b" returned: 0 in 0.430s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-84133938-27bf-403c-b93f-ff51d7f335f3 tempest-VolumesTransfersV357Test-1825161470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d0211992-98fa-4d57-9929-4654d57c5e1b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-873db099-2a66-42cb-bdd7-c69e1a571939 tempest-TestInstancesWithCinderVolumes-422999212 None] Acquiring lock "cinder-quobyte-d1a384ec-faa0-48f6-ba30-b8b54b43c0f8" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:44:00 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d0211992-98fa-4d57-9929-4654d57c5e1b Sep 05 11:44:00 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-873db099-2a66-42cb-bdd7-c69e1a571939 tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "cinder-quobyte-d1a384ec-faa0-48f6-ba30-b8b54b43c0f8" acquired by "delete_volume" :: waited 0.028s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:44:00 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[23125468-b550-4e50-8771-02d5823b89ad]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:44:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-873db099-2a66-42cb-bdd7-c69e1a571939 tempest-TestInstancesWithCinderVolumes-422999212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1a384ec-faa0-48f6-ba30-b8b54b43c0f8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:00 devstack sudo[99641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1a384ec-faa0-48f6-ba30-b8b54b43c0f8 Sep 05 11:44:00 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:00 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-84133938-27bf-403c-b93f-ff51d7f335f3 tempest-VolumesTransfersV357Test-1825161470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d0211992-98fa-4d57-9929-4654d57c5e1b" returned: 0 in 0.314s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-84133938-27bf-403c-b93f-ff51d7f335f3 tempest-VolumesTransfersV357Test-1825161470 None] Lock "cinder-quobyte-d0211992-98fa-4d57-9929-4654d57c5e1b" released by "delete_volume" :: held 0.794s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:44:01 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-84133938-27bf-403c-b93f-ff51d7f335f3 tempest-VolumesTransfersV357Test-1825161470 None] Created reservations ['0df12875-d6ad-420d-9bf3-4b5905f26e1c', 'f8e3e7f1-54b7-4483-ad76-d5a152d48d8f', '53b41258-a083-44d8-8617-c1a3b3ef49d6', 'a818f1bd-06cf-41b7-ba7d-03a4e61fefbe'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:44:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-84133938-27bf-403c-b93f-ff51d7f335f3 tempest-VolumesTransfersV357Test-1825161470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:44:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-84133938-27bf-403c-b93f-ff51d7f335f3 tempest-VolumesTransfersV357Test-1825161470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:44:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-84133938-27bf-403c-b93f-ff51d7f335f3 tempest-VolumesTransfersV357Test-1825161470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:44:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-84133938-27bf-403c-b93f-ff51d7f335f3 tempest-VolumesTransfersV357Test-1825161470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:44:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-84133938-27bf-403c-b93f-ff51d7f335f3 tempest-VolumesTransfersV357Test-1825161470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:44:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-84133938-27bf-403c-b93f-ff51d7f335f3 tempest-VolumesTransfersV357Test-1825161470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:01 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:44:01 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:01 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-873db099-2a66-42cb-bdd7-c69e1a571939 tempest-TestInstancesWithCinderVolumes-422999212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1a384ec-faa0-48f6-ba30-b8b54b43c0f8" returned: 0 in 0.417s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-873db099-2a66-42cb-bdd7-c69e1a571939 tempest-TestInstancesWithCinderVolumes-422999212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1a384ec-faa0-48f6-ba30-b8b54b43c0f8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:01 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1a384ec-faa0-48f6-ba30-b8b54b43c0f8 Sep 05 11:44:01 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:01 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-84133938-27bf-403c-b93f-ff51d7f335f3 tempest-VolumesTransfersV357Test-1825161470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.309s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:01 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-84133938-27bf-403c-b93f-ff51d7f335f3 tempest-VolumesTransfersV357Test-1825161470 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:44:01 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-84133938-27bf-403c-b93f-ff51d7f335f3 tempest-VolumesTransfersV357Test-1825161470 None] Deleted volume successfully. Sep 05 11:44:01 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-873db099-2a66-42cb-bdd7-c69e1a571939 tempest-TestInstancesWithCinderVolumes-422999212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1a384ec-faa0-48f6-ba30-b8b54b43c0f8" returned: 0 in 0.305s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-84133938-27bf-403c-b93f-ff51d7f335f3 tempest-VolumesTransfersV357Test-1825161470 None] Lock "cinder-d0211992-98fa-4d57-9929-4654d57c5e1b-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:44:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-873db099-2a66-42cb-bdd7-c69e1a571939 tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "cinder-quobyte-d1a384ec-faa0-48f6-ba30-b8b54b43c0f8" released by "delete_volume" :: held 0.785s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:44:01 devstack cinder-volume[87517]: WARNING cinder.quota [None req-873db099-2a66-42cb-bdd7-c69e1a571939 tempest-TestInstancesWithCinderVolumes-422999212 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2005546648-497021005 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2005546648-497021005, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:44:01 devstack cinder-volume[87517]: WARNING cinder.quota [None req-873db099-2a66-42cb-bdd7-c69e1a571939 tempest-TestInstancesWithCinderVolumes-422999212 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2005546648-497021005 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2005546648-497021005, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:44:01 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-873db099-2a66-42cb-bdd7-c69e1a571939 tempest-TestInstancesWithCinderVolumes-422999212 None] Created reservations ['ed226c60-ca19-4f59-b861-f66d92c5d179', 'db58ff40-d8db-481e-9f42-40c162ce8538', '975b6d20-284d-4409-a7e7-bf32ed122460', '26d9ce72-2238-4094-b1f6-8da3afdacd9d'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:44:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-873db099-2a66-42cb-bdd7-c69e1a571939 tempest-TestInstancesWithCinderVolumes-422999212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:44:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-873db099-2a66-42cb-bdd7-c69e1a571939 tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:44:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-873db099-2a66-42cb-bdd7-c69e1a571939 tempest-TestInstancesWithCinderVolumes-422999212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:44:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-873db099-2a66-42cb-bdd7-c69e1a571939 tempest-TestInstancesWithCinderVolumes-422999212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:44:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-873db099-2a66-42cb-bdd7-c69e1a571939 tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:44:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-873db099-2a66-42cb-bdd7-c69e1a571939 tempest-TestInstancesWithCinderVolumes-422999212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:01 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:44:01 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:01 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-873db099-2a66-42cb-bdd7-c69e1a571939 tempest-TestInstancesWithCinderVolumes-422999212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.330s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:01 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-873db099-2a66-42cb-bdd7-c69e1a571939 tempest-TestInstancesWithCinderVolumes-422999212 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:44:01 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-873db099-2a66-42cb-bdd7-c69e1a571939 tempest-TestInstancesWithCinderVolumes-422999212 None] Deleted volume successfully. Sep 05 11:44:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-873db099-2a66-42cb-bdd7-c69e1a571939 tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "cinder-d1a384ec-faa0-48f6-ba30-b8b54b43c0f8-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:44:04 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-1b3d7b15-f12f-488f-9810-a15aaa13f3b7 req-61cfb3e0-e045-4e96-a4ff-b15d28e9fd54 tempest-TestInstancesWithCinderVolumes-422999212 None] Terminate volume connection completed successfully. Sep 05 11:44:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-1b3d7b15-f12f-488f-9810-a15aaa13f3b7 req-61cfb3e0-e045-4e96-a4ff-b15d28e9fd54 tempest-TestInstancesWithCinderVolumes-422999212 None] Deleting attachment 43da63b4-ebbe-4959-9fc7-8939b1ce4e94. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 11:44:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-878fc555-2d04-49e5-8dea-4bf48a3a2d90 tempest-TestInstancesWithCinderVolumes-422999212 None] Acquiring lock "cinder-e8f8b484-5f65-4e75-b0f9-dfbf50d8a64b-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:44:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-878fc555-2d04-49e5-8dea-4bf48a3a2d90 tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "cinder-e8f8b484-5f65-4e75-b0f9-dfbf50d8a64b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:44:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-878fc555-2d04-49e5-8dea-4bf48a3a2d90 tempest-TestInstancesWithCinderVolumes-422999212 None] Acquiring lock "cinder-quobyte-e8f8b484-5f65-4e75-b0f9-dfbf50d8a64b" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:44:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-878fc555-2d04-49e5-8dea-4bf48a3a2d90 tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "cinder-quobyte-e8f8b484-5f65-4e75-b0f9-dfbf50d8a64b" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:44:05 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb82a713-0746-429b-aba3-f715e1c4e73a]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:44:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-878fc555-2d04-49e5-8dea-4bf48a3a2d90 tempest-TestInstancesWithCinderVolumes-422999212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e8f8b484-5f65-4e75-b0f9-dfbf50d8a64b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:05 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e8f8b484-5f65-4e75-b0f9-dfbf50d8a64b Sep 05 11:44:05 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:06 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-878fc555-2d04-49e5-8dea-4bf48a3a2d90 tempest-TestInstancesWithCinderVolumes-422999212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e8f8b484-5f65-4e75-b0f9-dfbf50d8a64b" returned: 0 in 0.498s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-878fc555-2d04-49e5-8dea-4bf48a3a2d90 tempest-TestInstancesWithCinderVolumes-422999212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e8f8b484-5f65-4e75-b0f9-dfbf50d8a64b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:06 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e8f8b484-5f65-4e75-b0f9-dfbf50d8a64b Sep 05 11:44:06 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:06 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-878fc555-2d04-49e5-8dea-4bf48a3a2d90 tempest-TestInstancesWithCinderVolumes-422999212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e8f8b484-5f65-4e75-b0f9-dfbf50d8a64b" returned: 0 in 0.319s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-878fc555-2d04-49e5-8dea-4bf48a3a2d90 tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "cinder-quobyte-e8f8b484-5f65-4e75-b0f9-dfbf50d8a64b" released by "delete_volume" :: held 0.874s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:44:06 devstack cinder-volume[87517]: WARNING cinder.quota [None req-878fc555-2d04-49e5-8dea-4bf48a3a2d90 tempest-TestInstancesWithCinderVolumes-422999212 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1749486094-1860047139 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1749486094-1860047139, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:44:06 devstack cinder-volume[87517]: WARNING cinder.quota [None req-878fc555-2d04-49e5-8dea-4bf48a3a2d90 tempest-TestInstancesWithCinderVolumes-422999212 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1749486094-1860047139 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1749486094-1860047139, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:44:06 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-878fc555-2d04-49e5-8dea-4bf48a3a2d90 tempest-TestInstancesWithCinderVolumes-422999212 None] Created reservations ['282ca7e9-6fa2-4b02-9ebb-e1d01244fda2', 'e0cbee26-1652-4f4a-9093-6e649ed98321', '52471245-acff-4b60-906b-33a8ec449120', '2f8bf4e3-4762-4e65-9c60-16f0e2a8a251'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:44:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-878fc555-2d04-49e5-8dea-4bf48a3a2d90 tempest-TestInstancesWithCinderVolumes-422999212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:44:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-878fc555-2d04-49e5-8dea-4bf48a3a2d90 tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:44:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-878fc555-2d04-49e5-8dea-4bf48a3a2d90 tempest-TestInstancesWithCinderVolumes-422999212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:44:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-878fc555-2d04-49e5-8dea-4bf48a3a2d90 tempest-TestInstancesWithCinderVolumes-422999212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:44:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-878fc555-2d04-49e5-8dea-4bf48a3a2d90 tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:44:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-878fc555-2d04-49e5-8dea-4bf48a3a2d90 tempest-TestInstancesWithCinderVolumes-422999212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:06 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:44:06 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:06 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-878fc555-2d04-49e5-8dea-4bf48a3a2d90 tempest-TestInstancesWithCinderVolumes-422999212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.337s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:06 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-878fc555-2d04-49e5-8dea-4bf48a3a2d90 tempest-TestInstancesWithCinderVolumes-422999212 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:44:06 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-878fc555-2d04-49e5-8dea-4bf48a3a2d90 tempest-TestInstancesWithCinderVolumes-422999212 None] Deleted volume successfully. Sep 05 11:44:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-878fc555-2d04-49e5-8dea-4bf48a3a2d90 tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "cinder-e8f8b484-5f65-4e75-b0f9-dfbf50d8a64b-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:44:09 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:44:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] Flow 'volume_create_manager' (31d835b9-6bf2-4d9c-8048-28b85ed9aeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:44:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27ed065c-0284-43ad-bf42-dfb3a96390e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27ed065c-0284-43ad-bf42-dfb3a96390e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-51698025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf928c7c-667d-4381-bd55-50096cdcf9dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e3c559d5ba4d46867fd4a2f5a486c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:44:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:44:09Z,use_quota=True,user_id='8a915e76952d4020a654417959a3b88f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3db91cad-4e4f-4d7b-8b87-23fa902ac87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3db91cad-4e4f-4d7b-8b87-23fa902ac87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5abcad1e-106a-4cfe-afa6-3ebd27ebc020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5abcad1e-106a-4cfe-afa6-3ebd27ebc020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf928c7c-667d-4381-bd55-50096cdcf9dd', 'volume_name': 'volume-cf928c7c-667d-4381-bd55-50096cdcf9dd', 'volume_size': 2}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1611f28-14d6-4625-a884-9711c3d93af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1611f28-14d6-4625-a884-9711c3d93af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (839ebd1f-3a27-4464-8737-0c5cbd2b68cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:09 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] Volume cf928c7c-667d-4381-bd55-50096cdcf9dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf928c7c-667d-4381-bd55-50096cdcf9dd', 'volume_size': 2} Sep 05 11:44:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:44:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:44:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-51698025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf928c7c-667d-4381-bd55-50096cdcf9dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e3c559d5ba4d46867fd4a2f5a486c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:44:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:44:09Z,use_quota=True,user_id='8a915e76952d4020a654417959a3b88f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:44:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] Creating volume cf928c7c-667d-4381-bd55-50096cdcf9dd {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:44:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:44:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:44:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:44:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:44:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:44:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:44:09 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:44:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cf928c7c-667d-4381-bd55-50096cdcf9dd 2147483648 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:09 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cf928c7c-667d-4381-bd55-50096cdcf9dd 2147483648 Sep 05 11:44:09 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:10 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cf928c7c-667d-4381-bd55-50096cdcf9dd 2147483648" returned: 0 in 0.776s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cf928c7c-667d-4381-bd55-50096cdcf9dd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:10 devstack sudo[99730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cf928c7c-667d-4381-bd55-50096cdcf9dd Sep 05 11:44:10 devstack sudo[99730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:10 devstack sudo[99730]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cf928c7c-667d-4381-bd55-50096cdcf9dd" returned: 0 in 0.310s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:44:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:44:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (839ebd1f-3a27-4464-8737-0c5cbd2b68cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf928c7c-667d-4381-bd55-50096cdcf9dd', 'volume_size': 2}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12623ab2-067e-4337-8b05-0a3336da772d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:10 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] Volume volume-cf928c7c-667d-4381-bd55-50096cdcf9dd (cf928c7c-667d-4381-bd55-50096cdcf9dd): created successfully Sep 05 11:44:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12623ab2-067e-4337-8b05-0a3336da772d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] Flow 'volume_create_manager' (31d835b9-6bf2-4d9c-8048-28b85ed9aeb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:44:10 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-cd747963-6adc-418d-a17a-be7a703f9f0d tempest-VolumesCloneNegativeTest-324165555 None] Created volume successfully. Sep 05 11:44:11 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-7272ee6a-e4ab-4201-90ad-a5e2d20d7b15 req-4157b953-fb4a-4f30-b413-acd6d74b9555 tempest-TestInstancesWithCinderVolumes-422999212 None] Terminate volume connection completed successfully. Sep 05 11:44:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-7272ee6a-e4ab-4201-90ad-a5e2d20d7b15 req-4157b953-fb4a-4f30-b413-acd6d74b9555 tempest-TestInstancesWithCinderVolumes-422999212 None] Deleting attachment e2c8203d-5cdb-46a5-a683-189ed2268584. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 11:44:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-38e8f2f7-0cbb-4ded-bd1a-634c919f213f tempest-VolumesCloneNegativeTest-324165555 None] Acquiring lock "cinder-cf928c7c-667d-4381-bd55-50096cdcf9dd-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:44:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-38e8f2f7-0cbb-4ded-bd1a-634c919f213f tempest-VolumesCloneNegativeTest-324165555 None] Lock "cinder-cf928c7c-667d-4381-bd55-50096cdcf9dd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:44:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-38e8f2f7-0cbb-4ded-bd1a-634c919f213f tempest-VolumesCloneNegativeTest-324165555 None] Acquiring lock "cinder-quobyte-cf928c7c-667d-4381-bd55-50096cdcf9dd" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:44:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-38e8f2f7-0cbb-4ded-bd1a-634c919f213f tempest-VolumesCloneNegativeTest-324165555 None] Lock "cinder-quobyte-cf928c7c-667d-4381-bd55-50096cdcf9dd" acquired by "delete_volume" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:44:11 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4170b2ea-34dc-4fc6-bb92-909fb7bb8949]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:44:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-38e8f2f7-0cbb-4ded-bd1a-634c919f213f tempest-VolumesCloneNegativeTest-324165555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cf928c7c-667d-4381-bd55-50096cdcf9dd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:11 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cf928c7c-667d-4381-bd55-50096cdcf9dd Sep 05 11:44:11 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:12 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-38e8f2f7-0cbb-4ded-bd1a-634c919f213f tempest-VolumesCloneNegativeTest-324165555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cf928c7c-667d-4381-bd55-50096cdcf9dd" returned: 0 in 0.490s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-38e8f2f7-0cbb-4ded-bd1a-634c919f213f tempest-VolumesCloneNegativeTest-324165555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cf928c7c-667d-4381-bd55-50096cdcf9dd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:12 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cf928c7c-667d-4381-bd55-50096cdcf9dd Sep 05 11:44:12 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:12 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-38e8f2f7-0cbb-4ded-bd1a-634c919f213f tempest-VolumesCloneNegativeTest-324165555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cf928c7c-667d-4381-bd55-50096cdcf9dd" returned: 0 in 0.295s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-38e8f2f7-0cbb-4ded-bd1a-634c919f213f tempest-VolumesCloneNegativeTest-324165555 None] Lock "cinder-quobyte-cf928c7c-667d-4381-bd55-50096cdcf9dd" released by "delete_volume" :: held 0.861s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:44:12 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-38e8f2f7-0cbb-4ded-bd1a-634c919f213f tempest-VolumesCloneNegativeTest-324165555 None] Created reservations ['8fc5475a-3dbb-4c26-b14d-a156a3305175', '470061b4-054d-4912-a788-2d4cc954c143', '080bd3b8-4b3e-4346-b7cc-509f02657e14', '3c1e35f1-a897-4fcd-b654-c22d79200d8d'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:44:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-38e8f2f7-0cbb-4ded-bd1a-634c919f213f tempest-VolumesCloneNegativeTest-324165555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:44:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-38e8f2f7-0cbb-4ded-bd1a-634c919f213f tempest-VolumesCloneNegativeTest-324165555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:44:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-38e8f2f7-0cbb-4ded-bd1a-634c919f213f tempest-VolumesCloneNegativeTest-324165555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:44:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-38e8f2f7-0cbb-4ded-bd1a-634c919f213f tempest-VolumesCloneNegativeTest-324165555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:44:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-38e8f2f7-0cbb-4ded-bd1a-634c919f213f tempest-VolumesCloneNegativeTest-324165555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:44:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-38e8f2f7-0cbb-4ded-bd1a-634c919f213f tempest-VolumesCloneNegativeTest-324165555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:12 devstack sudo[99760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:44:12 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:13 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-38e8f2f7-0cbb-4ded-bd1a-634c919f213f tempest-VolumesCloneNegativeTest-324165555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.322s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:13 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-38e8f2f7-0cbb-4ded-bd1a-634c919f213f tempest-VolumesCloneNegativeTest-324165555 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:44:13 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-38e8f2f7-0cbb-4ded-bd1a-634c919f213f tempest-VolumesCloneNegativeTest-324165555 None] Deleted volume successfully. Sep 05 11:44:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-38e8f2f7-0cbb-4ded-bd1a-634c919f213f tempest-VolumesCloneNegativeTest-324165555 None] Lock "cinder-cf928c7c-667d-4381-bd55-50096cdcf9dd-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:44:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5bc1c2a8-0b02-4f8d-95df-53f3ec6f13b9 tempest-TestInstancesWithCinderVolumes-422999212 None] Acquiring lock "cinder-ae2e6d16-1b0f-460e-b81b-65d5d669a666-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:44:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5bc1c2a8-0b02-4f8d-95df-53f3ec6f13b9 tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "cinder-ae2e6d16-1b0f-460e-b81b-65d5d669a666-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:44:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5bc1c2a8-0b02-4f8d-95df-53f3ec6f13b9 tempest-TestInstancesWithCinderVolumes-422999212 None] Acquiring lock "cinder-quobyte-ae2e6d16-1b0f-460e-b81b-65d5d669a666" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:44:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5bc1c2a8-0b02-4f8d-95df-53f3ec6f13b9 tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "cinder-quobyte-ae2e6d16-1b0f-460e-b81b-65d5d669a666" acquired by "delete_volume" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:44:13 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4003fc3-47c8-448f-82cc-f845bcee500b]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:44:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5bc1c2a8-0b02-4f8d-95df-53f3ec6f13b9 tempest-TestInstancesWithCinderVolumes-422999212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ae2e6d16-1b0f-460e-b81b-65d5d669a666 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:13 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ae2e6d16-1b0f-460e-b81b-65d5d669a666 Sep 05 11:44:13 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:13 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5bc1c2a8-0b02-4f8d-95df-53f3ec6f13b9 tempest-TestInstancesWithCinderVolumes-422999212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ae2e6d16-1b0f-460e-b81b-65d5d669a666" returned: 0 in 0.404s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5bc1c2a8-0b02-4f8d-95df-53f3ec6f13b9 tempest-TestInstancesWithCinderVolumes-422999212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ae2e6d16-1b0f-460e-b81b-65d5d669a666 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:13 devstack sudo[99769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ae2e6d16-1b0f-460e-b81b-65d5d669a666 Sep 05 11:44:13 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:14 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5bc1c2a8-0b02-4f8d-95df-53f3ec6f13b9 tempest-TestInstancesWithCinderVolumes-422999212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ae2e6d16-1b0f-460e-b81b-65d5d669a666" returned: 0 in 0.278s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5bc1c2a8-0b02-4f8d-95df-53f3ec6f13b9 tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "cinder-quobyte-ae2e6d16-1b0f-460e-b81b-65d5d669a666" released by "delete_volume" :: held 0.741s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:44:14 devstack cinder-volume[87517]: WARNING cinder.quota [None req-5bc1c2a8-0b02-4f8d-95df-53f3ec6f13b9 tempest-TestInstancesWithCinderVolumes-422999212 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1580969772-1901543439 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1580969772-1901543439, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:44:14 devstack cinder-volume[87517]: WARNING cinder.quota [None req-5bc1c2a8-0b02-4f8d-95df-53f3ec6f13b9 tempest-TestInstancesWithCinderVolumes-422999212 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1580969772-1901543439 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1580969772-1901543439, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:44:14 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-5bc1c2a8-0b02-4f8d-95df-53f3ec6f13b9 tempest-TestInstancesWithCinderVolumes-422999212 None] Created reservations ['7d29423c-2528-461e-89b0-1639a3db4042', '18a11e19-235d-4e42-80fe-4d31ac0e5e7a', 'fd63478f-1b6a-448c-b8b8-7c1bd2aedd0f', 'db33039b-84bb-4332-b37e-2af5ab5feddc'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:44:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5bc1c2a8-0b02-4f8d-95df-53f3ec6f13b9 tempest-TestInstancesWithCinderVolumes-422999212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:44:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5bc1c2a8-0b02-4f8d-95df-53f3ec6f13b9 tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:44:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5bc1c2a8-0b02-4f8d-95df-53f3ec6f13b9 tempest-TestInstancesWithCinderVolumes-422999212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:44:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5bc1c2a8-0b02-4f8d-95df-53f3ec6f13b9 tempest-TestInstancesWithCinderVolumes-422999212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:44:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5bc1c2a8-0b02-4f8d-95df-53f3ec6f13b9 tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:44:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5bc1c2a8-0b02-4f8d-95df-53f3ec6f13b9 tempest-TestInstancesWithCinderVolumes-422999212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:14 devstack sudo[99772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:44:14 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5bc1c2a8-0b02-4f8d-95df-53f3ec6f13b9 tempest-TestInstancesWithCinderVolumes-422999212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.331s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:14 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:14 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-5bc1c2a8-0b02-4f8d-95df-53f3ec6f13b9 tempest-TestInstancesWithCinderVolumes-422999212 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:44:14 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-5bc1c2a8-0b02-4f8d-95df-53f3ec6f13b9 tempest-TestInstancesWithCinderVolumes-422999212 None] Deleted volume successfully. Sep 05 11:44:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5bc1c2a8-0b02-4f8d-95df-53f3ec6f13b9 tempest-TestInstancesWithCinderVolumes-422999212 None] Lock "cinder-ae2e6d16-1b0f-460e-b81b-65d5d669a666-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:44:18 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:44:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] Flow 'volume_create_manager' (88950553-15bc-4304-8411-80da9b0fbb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:44:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e70ce8e-d14e-4c10-b6fd-ada1ee193859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e70ce8e-d14e-4c10-b6fd-ada1ee193859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1627597222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c5c8199-65d8-4bce-abf8-034604806e5e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da043e51974b4034a354413b6b01f27d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:44:18Z,use_quota=True,user_id='1cebb74b217748ad80089e580fb6917f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0529911b-76b7-4e5f-b2e6-30d8c10bcb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0529911b-76b7-4e5f-b2e6-30d8c10bcb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccffa77c-b5db-4882-b669-58981505784d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccffa77c-b5db-4882-b669-58981505784d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c5c8199-65d8-4bce-abf8-034604806e5e', 'volume_name': 'volume-9c5c8199-65d8-4bce-abf8-034604806e5e', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (704cafca-5de8-46f3-b075-b160fb754245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (704cafca-5de8-46f3-b075-b160fb754245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b662b8-5b0b-4395-9b61-d332e787d010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:18 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] Volume 9c5c8199-65d8-4bce-abf8-034604806e5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c5c8199-65d8-4bce-abf8-034604806e5e', 'volume_size': 1} Sep 05 11:44:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:44:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:44:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1627597222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c5c8199-65d8-4bce-abf8-034604806e5e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da043e51974b4034a354413b6b01f27d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:44:18Z,use_quota=True,user_id='1cebb74b217748ad80089e580fb6917f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:44:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] Creating volume 9c5c8199-65d8-4bce-abf8-034604806e5e {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:44:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:44:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:44:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:44:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:44:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:44:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:44:18 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:44:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9c5c8199-65d8-4bce-abf8-034604806e5e 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:18 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9c5c8199-65d8-4bce-abf8-034604806e5e 1073741824 Sep 05 11:44:18 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:19 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9c5c8199-65d8-4bce-abf8-034604806e5e 1073741824" returned: 0 in 0.619s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9c5c8199-65d8-4bce-abf8-034604806e5e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:19 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9c5c8199-65d8-4bce-abf8-034604806e5e Sep 05 11:44:19 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:19 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9c5c8199-65d8-4bce-abf8-034604806e5e" returned: 0 in 0.338s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:44:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:44:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b662b8-5b0b-4395-9b61-d332e787d010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c5c8199-65d8-4bce-abf8-034604806e5e', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd73b64c-6c3b-4917-905b-dfd9a898db62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:19 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] Volume volume-9c5c8199-65d8-4bce-abf8-034604806e5e (9c5c8199-65d8-4bce-abf8-034604806e5e): created successfully Sep 05 11:44:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd73b64c-6c3b-4917-905b-dfd9a898db62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] Flow 'volume_create_manager' (88950553-15bc-4304-8411-80da9b0fbb8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:44:19 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-40b3faec-5714-42a4-b0bb-cfacd207aa62 tempest-VolumesListTestJSON-810189666 None] Created volume successfully. Sep 05 11:44:21 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:44:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] Flow 'volume_create_manager' (3091968c-12ba-4dd6-9d96-7e82dc0b4c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:44:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a290c44e-33c5-45b7-a734-c76d9d5ffff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a290c44e-33c5-45b7-a734-c76d9d5ffff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-788007775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d02f5e-24f2-4430-8c82-cf8691828b0b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da043e51974b4034a354413b6b01f27d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:44:21Z,use_quota=True,user_id='1cebb74b217748ad80089e580fb6917f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (343032b5-7df3-43d0-8f01-a153fb5a6e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (343032b5-7df3-43d0-8f01-a153fb5a6e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6fd8d09-1f89-4186-a0ff-353027eb8049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6fd8d09-1f89-4186-a0ff-353027eb8049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66d02f5e-24f2-4430-8c82-cf8691828b0b', 'volume_name': 'volume-66d02f5e-24f2-4430-8c82-cf8691828b0b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9988286-e258-4745-86ca-dfba6a73cafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9988286-e258-4745-86ca-dfba6a73cafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72fdd6fc-3b89-4035-b702-941424284b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:21 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] Volume 66d02f5e-24f2-4430-8c82-cf8691828b0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66d02f5e-24f2-4430-8c82-cf8691828b0b', 'volume_size': 1} Sep 05 11:44:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:44:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:44:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-788007775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d02f5e-24f2-4430-8c82-cf8691828b0b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da043e51974b4034a354413b6b01f27d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:44:21Z,use_quota=True,user_id='1cebb74b217748ad80089e580fb6917f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:44:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] Creating volume 66d02f5e-24f2-4430-8c82-cf8691828b0b {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:44:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:44:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:44:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:44:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:44:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:44:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:44:21 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:44:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-66d02f5e-24f2-4430-8c82-cf8691828b0b 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:21 devstack sudo[99856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-66d02f5e-24f2-4430-8c82-cf8691828b0b 1073741824 Sep 05 11:44:21 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:21 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-66d02f5e-24f2-4430-8c82-cf8691828b0b 1073741824" returned: 0 in 0.487s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-66d02f5e-24f2-4430-8c82-cf8691828b0b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:21 devstack sudo[99862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-66d02f5e-24f2-4430-8c82-cf8691828b0b Sep 05 11:44:21 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:21 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-66d02f5e-24f2-4430-8c82-cf8691828b0b" returned: 0 in 0.282s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:44:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:44:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72fdd6fc-3b89-4035-b702-941424284b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66d02f5e-24f2-4430-8c82-cf8691828b0b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93970dfe-09fc-44c4-ab74-372bf7b6a6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:22 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] Volume volume-66d02f5e-24f2-4430-8c82-cf8691828b0b (66d02f5e-24f2-4430-8c82-cf8691828b0b): created successfully Sep 05 11:44:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93970dfe-09fc-44c4-ab74-372bf7b6a6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] Flow 'volume_create_manager' (3091968c-12ba-4dd6-9d96-7e82dc0b4c83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:44:22 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d906b784-d2ad-4e24-a515-354586224e4c tempest-VolumesListTestJSON-810189666 None] Created volume successfully. Sep 05 11:44:23 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:44:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] Flow 'volume_create_manager' (5ff93dde-6bce-44d3-9bcc-a27577a085b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:44:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ecbe88f-b1c1-4496-aecd-d8a078c642d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ecbe88f-b1c1-4496-aecd-d8a078c642d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1916759868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c379aa4-62d8-4209-a8c7-7ec05d034c25,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da043e51974b4034a354413b6b01f27d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:44:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:44:24Z,use_quota=True,user_id='1cebb74b217748ad80089e580fb6917f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae66c157-4107-46d0-ae41-a851aa42f74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae66c157-4107-46d0-ae41-a851aa42f74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9afcb906-a0a4-420b-af47-6cffc6524821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9afcb906-a0a4-420b-af47-6cffc6524821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c379aa4-62d8-4209-a8c7-7ec05d034c25', 'volume_name': 'volume-2c379aa4-62d8-4209-a8c7-7ec05d034c25', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d94daef3-1c8b-4afd-b1b8-970276a23c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d94daef3-1c8b-4afd-b1b8-970276a23c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9892ed43-3381-480f-b32b-34260d16b890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:23 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] Volume 2c379aa4-62d8-4209-a8c7-7ec05d034c25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c379aa4-62d8-4209-a8c7-7ec05d034c25', 'volume_size': 1} Sep 05 11:44:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:44:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:44:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1916759868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c379aa4-62d8-4209-a8c7-7ec05d034c25,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da043e51974b4034a354413b6b01f27d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:44:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:44:24Z,use_quota=True,user_id='1cebb74b217748ad80089e580fb6917f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:44:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] Creating volume 2c379aa4-62d8-4209-a8c7-7ec05d034c25 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:44:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:44:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:44:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:44:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:44:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:44:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:44:23 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:44:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2c379aa4-62d8-4209-a8c7-7ec05d034c25 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:23 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2c379aa4-62d8-4209-a8c7-7ec05d034c25 1073741824 Sep 05 11:44:23 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:24 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2c379aa4-62d8-4209-a8c7-7ec05d034c25 1073741824" returned: 0 in 0.529s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2c379aa4-62d8-4209-a8c7-7ec05d034c25 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:24 devstack sudo[99876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2c379aa4-62d8-4209-a8c7-7ec05d034c25 Sep 05 11:44:24 devstack sudo[99876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:24 devstack sudo[99876]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2c379aa4-62d8-4209-a8c7-7ec05d034c25" returned: 0 in 0.274s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:44:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:44:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9892ed43-3381-480f-b32b-34260d16b890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c379aa4-62d8-4209-a8c7-7ec05d034c25', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aafe8edb-9469-4e8c-bd2d-37b81ed92f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:24 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] Volume volume-2c379aa4-62d8-4209-a8c7-7ec05d034c25 (2c379aa4-62d8-4209-a8c7-7ec05d034c25): created successfully Sep 05 11:44:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aafe8edb-9469-4e8c-bd2d-37b81ed92f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] Flow 'volume_create_manager' (5ff93dde-6bce-44d3-9bcc-a27577a085b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:44:24 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-9f20a408-fcb4-4a08-a524-8f3e3c116a6e tempest-VolumesListTestJSON-810189666 None] Created volume successfully. Sep 05 11:44:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e7c51e95-43b0-4887-989c-3bc940c247b6 tempest-VolumesListTestJSON-810189666 None] Acquiring lock "cinder-2c379aa4-62d8-4209-a8c7-7ec05d034c25-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:44:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e7c51e95-43b0-4887-989c-3bc940c247b6 tempest-VolumesListTestJSON-810189666 None] Lock "cinder-2c379aa4-62d8-4209-a8c7-7ec05d034c25-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:44:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e7c51e95-43b0-4887-989c-3bc940c247b6 tempest-VolumesListTestJSON-810189666 None] Acquiring lock "cinder-quobyte-2c379aa4-62d8-4209-a8c7-7ec05d034c25" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:44:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e7c51e95-43b0-4887-989c-3bc940c247b6 tempest-VolumesListTestJSON-810189666 None] Lock "cinder-quobyte-2c379aa4-62d8-4209-a8c7-7ec05d034c25" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:44:28 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea919be-6cb6-4024-b427-abd114da93d4]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:44:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e7c51e95-43b0-4887-989c-3bc940c247b6 tempest-VolumesListTestJSON-810189666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2c379aa4-62d8-4209-a8c7-7ec05d034c25 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:28 devstack sudo[99880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2c379aa4-62d8-4209-a8c7-7ec05d034c25 Sep 05 11:44:28 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:29 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e7c51e95-43b0-4887-989c-3bc940c247b6 tempest-VolumesListTestJSON-810189666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2c379aa4-62d8-4209-a8c7-7ec05d034c25" returned: 0 in 0.412s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e7c51e95-43b0-4887-989c-3bc940c247b6 tempest-VolumesListTestJSON-810189666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2c379aa4-62d8-4209-a8c7-7ec05d034c25 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:29 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2c379aa4-62d8-4209-a8c7-7ec05d034c25 Sep 05 11:44:29 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:29 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e7c51e95-43b0-4887-989c-3bc940c247b6 tempest-VolumesListTestJSON-810189666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2c379aa4-62d8-4209-a8c7-7ec05d034c25" returned: 0 in 0.273s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e7c51e95-43b0-4887-989c-3bc940c247b6 tempest-VolumesListTestJSON-810189666 None] Lock "cinder-quobyte-2c379aa4-62d8-4209-a8c7-7ec05d034c25" released by "delete_volume" :: held 0.740s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:44:29 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-e7c51e95-43b0-4887-989c-3bc940c247b6 tempest-VolumesListTestJSON-810189666 None] Created reservations ['7d1a8ebb-2584-4476-bf27-f1ba9113aee5', 'd4d027b4-9e09-4990-a6d2-1ce02f9a3150', 'a6d6d2eb-da42-40a7-9c1f-8ca2277b376b', '764477c1-6b49-440e-a05a-04444725da04'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:44:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e7c51e95-43b0-4887-989c-3bc940c247b6 tempest-VolumesListTestJSON-810189666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:44:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e7c51e95-43b0-4887-989c-3bc940c247b6 tempest-VolumesListTestJSON-810189666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:44:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e7c51e95-43b0-4887-989c-3bc940c247b6 tempest-VolumesListTestJSON-810189666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:44:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e7c51e95-43b0-4887-989c-3bc940c247b6 tempest-VolumesListTestJSON-810189666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:44:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e7c51e95-43b0-4887-989c-3bc940c247b6 tempest-VolumesListTestJSON-810189666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:44:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e7c51e95-43b0-4887-989c-3bc940c247b6 tempest-VolumesListTestJSON-810189666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:29 devstack sudo[99915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:44:29 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:29 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e7c51e95-43b0-4887-989c-3bc940c247b6 tempest-VolumesListTestJSON-810189666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.277s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:29 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-e7c51e95-43b0-4887-989c-3bc940c247b6 tempest-VolumesListTestJSON-810189666 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:44:29 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e7c51e95-43b0-4887-989c-3bc940c247b6 tempest-VolumesListTestJSON-810189666 None] Deleted volume successfully. Sep 05 11:44:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-37697541-64f3-4623-9af7-8498857c344e tempest-VolumesListTestJSON-810189666 None] Acquiring lock "cinder-66d02f5e-24f2-4430-8c82-cf8691828b0b-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:44:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-37697541-64f3-4623-9af7-8498857c344e tempest-VolumesListTestJSON-810189666 None] Lock "cinder-66d02f5e-24f2-4430-8c82-cf8691828b0b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:44:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e7c51e95-43b0-4887-989c-3bc940c247b6 tempest-VolumesListTestJSON-810189666 None] Lock "cinder-2c379aa4-62d8-4209-a8c7-7ec05d034c25-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:44:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-37697541-64f3-4623-9af7-8498857c344e tempest-VolumesListTestJSON-810189666 None] Acquiring lock "cinder-quobyte-66d02f5e-24f2-4430-8c82-cf8691828b0b" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:44:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-37697541-64f3-4623-9af7-8498857c344e tempest-VolumesListTestJSON-810189666 None] Lock "cinder-quobyte-66d02f5e-24f2-4430-8c82-cf8691828b0b" acquired by "delete_volume" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:44:30 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ce41b4-8ede-4f09-9637-54851a1b0331]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:44:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-37697541-64f3-4623-9af7-8498857c344e tempest-VolumesListTestJSON-810189666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-66d02f5e-24f2-4430-8c82-cf8691828b0b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:30 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-66d02f5e-24f2-4430-8c82-cf8691828b0b Sep 05 11:44:30 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:30 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-37697541-64f3-4623-9af7-8498857c344e tempest-VolumesListTestJSON-810189666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-66d02f5e-24f2-4430-8c82-cf8691828b0b" returned: 0 in 0.412s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-37697541-64f3-4623-9af7-8498857c344e tempest-VolumesListTestJSON-810189666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-66d02f5e-24f2-4430-8c82-cf8691828b0b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:30 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-66d02f5e-24f2-4430-8c82-cf8691828b0b Sep 05 11:44:30 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:30 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-37697541-64f3-4623-9af7-8498857c344e tempest-VolumesListTestJSON-810189666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-66d02f5e-24f2-4430-8c82-cf8691828b0b" returned: 0 in 0.295s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-37697541-64f3-4623-9af7-8498857c344e tempest-VolumesListTestJSON-810189666 None] Lock "cinder-quobyte-66d02f5e-24f2-4430-8c82-cf8691828b0b" released by "delete_volume" :: held 0.751s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:44:30 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-37697541-64f3-4623-9af7-8498857c344e tempest-VolumesListTestJSON-810189666 None] Created reservations ['a37e15c2-90f1-4e9c-b573-26d76f3bb2be', 'e8e96451-e6c7-4e55-b159-8d6b156fe702', 'a119871b-ca5e-4230-b904-9a7309f530da', 'b75cea62-549f-47ca-9b32-40d2bc33c5b3'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:44:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-37697541-64f3-4623-9af7-8498857c344e tempest-VolumesListTestJSON-810189666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:44:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-37697541-64f3-4623-9af7-8498857c344e tempest-VolumesListTestJSON-810189666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:44:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-37697541-64f3-4623-9af7-8498857c344e tempest-VolumesListTestJSON-810189666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:44:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-37697541-64f3-4623-9af7-8498857c344e tempest-VolumesListTestJSON-810189666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:44:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-37697541-64f3-4623-9af7-8498857c344e tempest-VolumesListTestJSON-810189666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:44:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-37697541-64f3-4623-9af7-8498857c344e tempest-VolumesListTestJSON-810189666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:30 devstack sudo[99963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:44:30 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:31 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-37697541-64f3-4623-9af7-8498857c344e tempest-VolumesListTestJSON-810189666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.298s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:31 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-37697541-64f3-4623-9af7-8498857c344e tempest-VolumesListTestJSON-810189666 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:44:31 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-37697541-64f3-4623-9af7-8498857c344e tempest-VolumesListTestJSON-810189666 None] Deleted volume successfully. Sep 05 11:44:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-68f775ed-fd3a-45c6-8731-5ac2c9d14904 tempest-VolumesListTestJSON-810189666 None] Acquiring lock "cinder-9c5c8199-65d8-4bce-abf8-034604806e5e-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:44:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-37697541-64f3-4623-9af7-8498857c344e tempest-VolumesListTestJSON-810189666 None] Lock "cinder-66d02f5e-24f2-4430-8c82-cf8691828b0b-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:44:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-68f775ed-fd3a-45c6-8731-5ac2c9d14904 tempest-VolumesListTestJSON-810189666 None] Lock "cinder-9c5c8199-65d8-4bce-abf8-034604806e5e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:44:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-68f775ed-fd3a-45c6-8731-5ac2c9d14904 tempest-VolumesListTestJSON-810189666 None] Acquiring lock "cinder-quobyte-9c5c8199-65d8-4bce-abf8-034604806e5e" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:44:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-68f775ed-fd3a-45c6-8731-5ac2c9d14904 tempest-VolumesListTestJSON-810189666 None] Lock "cinder-quobyte-9c5c8199-65d8-4bce-abf8-034604806e5e" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:44:31 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e5cb11-e05e-4e91-82e7-8949f52c0e7a]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:44:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-68f775ed-fd3a-45c6-8731-5ac2c9d14904 tempest-VolumesListTestJSON-810189666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9c5c8199-65d8-4bce-abf8-034604806e5e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:31 devstack sudo[99966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9c5c8199-65d8-4bce-abf8-034604806e5e Sep 05 11:44:31 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:31 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-68f775ed-fd3a-45c6-8731-5ac2c9d14904 tempest-VolumesListTestJSON-810189666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9c5c8199-65d8-4bce-abf8-034604806e5e" returned: 0 in 0.397s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-68f775ed-fd3a-45c6-8731-5ac2c9d14904 tempest-VolumesListTestJSON-810189666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9c5c8199-65d8-4bce-abf8-034604806e5e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:31 devstack sudo[99971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9c5c8199-65d8-4bce-abf8-034604806e5e Sep 05 11:44:31 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:31 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-68f775ed-fd3a-45c6-8731-5ac2c9d14904 tempest-VolumesListTestJSON-810189666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9c5c8199-65d8-4bce-abf8-034604806e5e" returned: 0 in 0.250s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-68f775ed-fd3a-45c6-8731-5ac2c9d14904 tempest-VolumesListTestJSON-810189666 None] Lock "cinder-quobyte-9c5c8199-65d8-4bce-abf8-034604806e5e" released by "delete_volume" :: held 0.696s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:44:32 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-68f775ed-fd3a-45c6-8731-5ac2c9d14904 tempest-VolumesListTestJSON-810189666 None] Created reservations ['dff094e9-645c-4b05-a8db-425520bbf078', '9b0e29ff-9d40-46cd-b7a7-55c5f9610134', '4baa92cb-fb99-4f96-96e5-28dee4816ffa', 'd22b29a4-f726-462e-bf17-dae81f1b44c0'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:44:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-68f775ed-fd3a-45c6-8731-5ac2c9d14904 tempest-VolumesListTestJSON-810189666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:44:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-68f775ed-fd3a-45c6-8731-5ac2c9d14904 tempest-VolumesListTestJSON-810189666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:44:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-68f775ed-fd3a-45c6-8731-5ac2c9d14904 tempest-VolumesListTestJSON-810189666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:44:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-68f775ed-fd3a-45c6-8731-5ac2c9d14904 tempest-VolumesListTestJSON-810189666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:44:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-68f775ed-fd3a-45c6-8731-5ac2c9d14904 tempest-VolumesListTestJSON-810189666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:44:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-68f775ed-fd3a-45c6-8731-5ac2c9d14904 tempest-VolumesListTestJSON-810189666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:32 devstack sudo[99975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:44:32 devstack sudo[99975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:44:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:44:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:44:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:44:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:44:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:44:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:32 devstack sudo[99977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:44:32 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:32 devstack sudo[99975]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-68f775ed-fd3a-45c6-8731-5ac2c9d14904 tempest-VolumesListTestJSON-810189666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.284s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:32 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-68f775ed-fd3a-45c6-8731-5ac2c9d14904 tempest-VolumesListTestJSON-810189666 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:44:32 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-68f775ed-fd3a-45c6-8731-5ac2c9d14904 tempest-VolumesListTestJSON-810189666 None] Deleted volume successfully. Sep 05 11:44:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-68f775ed-fd3a-45c6-8731-5ac2c9d14904 tempest-VolumesListTestJSON-810189666 None] Lock "cinder-9c5c8199-65d8-4bce-abf8-034604806e5e-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:44:32 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.339s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:32 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:44:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:44:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread count: 28 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 11:44:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread info: [<_MainThread(MainThread, started 131707869511808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 11:44:36 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:44:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Flow 'volume_create_manager' (924c7e12-032d-4a9e-9ef4-a460029a6a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:44:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f7d018f-86c7-46cb-9843-e02a0ce0bd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f7d018f-86c7-46cb-9843-e02a0ce0bd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-215968796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e0d526-175b-4ebe-a3e8-bbf6f44219e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dd2f7f374994dababcdfb6bf1e88e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:44:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:44:37Z,use_quota=True,user_id='cfcab5acc0df4801890e8e0a9ff0909f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4df02f6d-7847-47ab-944a-87b5d460c7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4df02f6d-7847-47ab-944a-87b5d460c7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c753c8-c439-446c-864f-fc66aaa732f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c753c8-c439-446c-864f-fc66aaa732f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1e0d526-175b-4ebe-a3e8-bbf6f44219e7', 'volume_name': 'volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7', 'volume_size': 2}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337f5d99-ead8-4fbe-a58c-8fe09456a54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337f5d99-ead8-4fbe-a58c-8fe09456a54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c63b629-4909-45da-8044-1ab72b95b759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:36 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Volume e1e0d526-175b-4ebe-a3e8-bbf6f44219e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7', 'volume_size': 2} Sep 05 11:44:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:44:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:44:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-215968796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e0d526-175b-4ebe-a3e8-bbf6f44219e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dd2f7f374994dababcdfb6bf1e88e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:44:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:44:37Z,use_quota=True,user_id='cfcab5acc0df4801890e8e0a9ff0909f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:44:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Creating volume e1e0d526-175b-4ebe-a3e8-bbf6f44219e7 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:44:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:44:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:44:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:44:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:44:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:44:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:44:36 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:44:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7 2147483648 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:36 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7 2147483648 Sep 05 11:44:36 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:37 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7 2147483648" returned: 0 in 0.700s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:37 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7 Sep 05 11:44:37 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:37 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7" returned: 0 in 0.289s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:44:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:44:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c63b629-4909-45da-8044-1ab72b95b759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7', 'volume_size': 2}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b76c5c-fb46-4626-8a4d-d48d52adef20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:37 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Volume volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7 (e1e0d526-175b-4ebe-a3e8-bbf6f44219e7): created successfully Sep 05 11:44:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b76c5c-fb46-4626-8a4d-d48d52adef20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Flow 'volume_create_manager' (924c7e12-032d-4a9e-9ef4-a460029a6a12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:44:37 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7ed1c6c1-235f-425f-85e8-1d19d6828888 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Created volume successfully. Sep 05 11:44:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-227d5a6f-8ebf-4acc-b074-e1f6952d6761 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:44:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-227d5a6f-8ebf-4acc-b074-e1f6952d6761 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:44:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-227d5a6f-8ebf-4acc-b074-e1f6952d6761 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Creating offline snapshot 2974ab55-38e0-4814-b3f0-5ecd7beba06f of volume e1e0d526-175b-4ebe-a3e8-bbf6f44219e7 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:44:39 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[582868de-de37-40cd-a665-dc708ed1bea4]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:44:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-227d5a6f-8ebf-4acc-b074-e1f6952d6761 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:39 devstack sudo[100000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7 Sep 05 11:44:39 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:39 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-227d5a6f-8ebf-4acc-b074-e1f6952d6761 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7" returned: 0 in 0.666s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-227d5a6f-8ebf-4acc-b074-e1f6952d6761 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7.2974ab55-38e0-4814-b3f0-5ecd7beba06f 2G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:39 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7.2974ab55-38e0-4814-b3f0-5ecd7beba06f 2G Sep 05 11:44:39 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:39 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:44:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] Flow 'volume_create_manager' (40c053be-d779-4d21-9704-295f454cef53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:44:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675097dd-9693-46b7-83e6-16458bf2ec05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675097dd-9693-46b7-83e6-16458bf2ec05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1098956907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86914b9c-d631-4345-9d23-d086761b6eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c878f179b2d443908f5e69ae85f6a12d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:44:40Z,use_quota=True,user_id='56a4a548fd774fbd8eddf862e4f2abf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4954fa6f-e4ca-4b98-9cb3-f7fae7d0738b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4954fa6f-e4ca-4b98-9cb3-f7fae7d0738b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28eb35a3-6818-4ad7-b82c-9fe5c3481c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28eb35a3-6818-4ad7-b82c-9fe5c3481c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86914b9c-d631-4345-9d23-d086761b6eb1', 'volume_name': 'volume-86914b9c-d631-4345-9d23-d086761b6eb1', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf721bb-2e9b-4fbb-a2e6-af3f3617842c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf721bb-2e9b-4fbb-a2e6-af3f3617842c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d4e5e0c-e7c5-4a04-920e-be4ae94314c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:40 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] Volume 86914b9c-d631-4345-9d23-d086761b6eb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86914b9c-d631-4345-9d23-d086761b6eb1', 'volume_size': 1} Sep 05 11:44:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:44:40 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-227d5a6f-8ebf-4acc-b074-e1f6952d6761 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7.2974ab55-38e0-4814-b3f0-5ecd7beba06f 2G" returned: 0 in 0.470s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-227d5a6f-8ebf-4acc-b074-e1f6952d6761 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7.2974ab55-38e0-4814-b3f0-5ecd7beba06f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:40 devstack sudo[100012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7.2974ab55-38e0-4814-b3f0-5ecd7beba06f Sep 05 11:44:40 devstack sudo[100012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:40 devstack sudo[100012]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-227d5a6f-8ebf-4acc-b074-e1f6952d6761 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7.2974ab55-38e0-4814-b3f0-5ecd7beba06f" returned: 0 in 0.327s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:40 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-227d5a6f-8ebf-4acc-b074-e1f6952d6761 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7.2974ab55-38e0-4814-b3f0-5ecd7beba06f is being set with open permissions: ugo+rw Sep 05 11:44:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-227d5a6f-8ebf-4acc-b074-e1f6952d6761 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7.2974ab55-38e0-4814-b3f0-5ecd7beba06f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:40 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7.2974ab55-38e0-4814-b3f0-5ecd7beba06f Sep 05 11:44:40 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:40 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-227d5a6f-8ebf-4acc-b074-e1f6952d6761 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7.2974ab55-38e0-4814-b3f0-5ecd7beba06f" returned: 0 in 0.281s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-227d5a6f-8ebf-4acc-b074-e1f6952d6761 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:40 devstack sudo[100021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7.info Sep 05 11:44:40 devstack sudo[100021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:41 devstack sudo[100021]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-227d5a6f-8ebf-4acc-b074-e1f6952d6761 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7.info" returned: 0 in 0.286s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:41 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-227d5a6f-8ebf-4acc-b074-e1f6952d6761 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7.info is being set with open permissions: ugo+rw Sep 05 11:44:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-227d5a6f-8ebf-4acc-b074-e1f6952d6761 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:41 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7.info Sep 05 11:44:41 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:41 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-227d5a6f-8ebf-4acc-b074-e1f6952d6761 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7.info" returned: 0 in 0.279s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-227d5a6f-8ebf-4acc-b074-e1f6952d6761 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.429s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:44:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.402s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:44:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1098956907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86914b9c-d631-4345-9d23-d086761b6eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c878f179b2d443908f5e69ae85f6a12d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:44:40Z,use_quota=True,user_id='56a4a548fd774fbd8eddf862e4f2abf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:44:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] Creating volume 86914b9c-d631-4345-9d23-d086761b6eb1 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:44:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:44:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:44:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:44:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:44:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:44:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:44:41 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:44:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-86914b9c-d631-4345-9d23-d086761b6eb1 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:41 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-86914b9c-d631-4345-9d23-d086761b6eb1 1073741824 Sep 05 11:44:41 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:41 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-227d5a6f-8ebf-4acc-b074-e1f6952d6761 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Create snapshot completed successfully Sep 05 11:44:41 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-86914b9c-d631-4345-9d23-d086761b6eb1 1073741824" returned: 0 in 0.453s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-86914b9c-d631-4345-9d23-d086761b6eb1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:42 devstack sudo[100034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-86914b9c-d631-4345-9d23-d086761b6eb1 Sep 05 11:44:42 devstack sudo[100034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:42 devstack sudo[100034]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-86914b9c-d631-4345-9d23-d086761b6eb1" returned: 0 in 0.277s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:44:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:44:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d4e5e0c-e7c5-4a04-920e-be4ae94314c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86914b9c-d631-4345-9d23-d086761b6eb1', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d7d3fdc-8535-4683-8c39-0b564a1d3083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:42 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] Volume volume-86914b9c-d631-4345-9d23-d086761b6eb1 (86914b9c-d631-4345-9d23-d086761b6eb1): created successfully Sep 05 11:44:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d7d3fdc-8535-4683-8c39-0b564a1d3083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] Flow 'volume_create_manager' (40c053be-d779-4d21-9704-295f454cef53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:44:42 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-13d4aec9-6b92-4f86-9ca4-fcd468977e3f tempest-AttachVolumeTestJSON-1706745870 None] Created volume successfully. Sep 05 11:44:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-36b78ead-e525-4f9e-a34a-37b1683c1a79 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Acquiring lock "cinder-2974ab55-38e0-4814-b3f0-5ecd7beba06f-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:44:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-36b78ead-e525-4f9e-a34a-37b1683c1a79 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Lock "cinder-2974ab55-38e0-4814-b3f0-5ecd7beba06f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:44:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-36b78ead-e525-4f9e-a34a-37b1683c1a79 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Acquiring lock "cinder-quobyte-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:44:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-36b78ead-e525-4f9e-a34a-37b1683c1a79 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Lock "cinder-quobyte-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:44:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-36b78ead-e525-4f9e-a34a-37b1683c1a79 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Acquiring lock "cinder-quobyte-2974ab55-38e0-4814-b3f0-5ecd7beba06f" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:44:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-36b78ead-e525-4f9e-a34a-37b1683c1a79 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Lock "cinder-quobyte-2974ab55-38e0-4814-b3f0-5ecd7beba06f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:44:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-36b78ead-e525-4f9e-a34a-37b1683c1a79 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Deleting offline snapshot 2974ab55-38e0-4814-b3f0-5ecd7beba06f of volume e1e0d526-175b-4ebe-a3e8-bbf6f44219e7 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:44:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-36b78ead-e525-4f9e-a34a-37b1683c1a79 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] snapshot_file for this snap is: volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7.2974ab55-38e0-4814-b3f0-5ecd7beba06f {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:44:42 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[9552b2d1-6e2f-4c02-a6be-7a8dda8379be]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:44:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-36b78ead-e525-4f9e-a34a-37b1683c1a79 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7.2974ab55-38e0-4814-b3f0-5ecd7beba06f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:42 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7.2974ab55-38e0-4814-b3f0-5ecd7beba06f Sep 05 11:44:42 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:42 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-36b78ead-e525-4f9e-a34a-37b1683c1a79 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7.2974ab55-38e0-4814-b3f0-5ecd7beba06f" returned: 0 in 0.371s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-36b78ead-e525-4f9e-a34a-37b1683c1a79 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:44:42 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[6162a2fb-e9c3-46fd-865a-8603e74d70e4]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:44:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-36b78ead-e525-4f9e-a34a-37b1683c1a79 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:42 devstack sudo[100043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7 Sep 05 11:44:42 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:43 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-36b78ead-e525-4f9e-a34a-37b1683c1a79 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7" returned: 0 in 0.418s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-36b78ead-e525-4f9e-a34a-37b1683c1a79 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7.2974ab55-38e0-4814-b3f0-5ecd7beba06f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:43 devstack sudo[100051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7.2974ab55-38e0-4814-b3f0-5ecd7beba06f Sep 05 11:44:43 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:43 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-36b78ead-e525-4f9e-a34a-37b1683c1a79 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7.2974ab55-38e0-4814-b3f0-5ecd7beba06f" returned: 0 in 0.501s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-36b78ead-e525-4f9e-a34a-37b1683c1a79 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7.2974ab55-38e0-4814-b3f0-5ecd7beba06f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:43 devstack sudo[100063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7.2974ab55-38e0-4814-b3f0-5ecd7beba06f Sep 05 11:44:43 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-ae04791b-6e53-4e25-8939-17e5606fb61a req-1a5aa16e-476d-4bdb-b40f-6eb7e02a6f5d tempest-AttachVolumeTestJSON-1706745870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:44:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-ae04791b-6e53-4e25-8939-17e5606fb61a req-1a5aa16e-476d-4bdb-b40f-6eb7e02a6f5d tempest-AttachVolumeTestJSON-1706745870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:44:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-ae04791b-6e53-4e25-8939-17e5606fb61a req-1a5aa16e-476d-4bdb-b40f-6eb7e02a6f5d tempest-AttachVolumeTestJSON-1706745870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:44:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-ae04791b-6e53-4e25-8939-17e5606fb61a req-1a5aa16e-476d-4bdb-b40f-6eb7e02a6f5d tempest-AttachVolumeTestJSON-1706745870 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32', 'name': 'volume-86914b9c-d631-4345-9d23-d086761b6eb1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '157457a7-0c81-40e8-887e-873a6a5d12bf', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 11:44:44 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-36b78ead-e525-4f9e-a34a-37b1683c1a79 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7.2974ab55-38e0-4814-b3f0-5ecd7beba06f" returned: 0 in 0.276s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:44 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-ae04791b-6e53-4e25-8939-17e5606fb61a req-1a5aa16e-476d-4bdb-b40f-6eb7e02a6f5d tempest-AttachVolumeTestJSON-1706745870 None] attachment_update completed successfully. Sep 05 11:44:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-36b78ead-e525-4f9e-a34a-37b1683c1a79 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Lock "cinder-quobyte-2974ab55-38e0-4814-b3f0-5ecd7beba06f" released by "_delete_snapshot" :: held 1.680s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:44:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-36b78ead-e525-4f9e-a34a-37b1683c1a79 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Lock "cinder-quobyte-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7" released by "delete_snapshot" :: held 1.706s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:44:44 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-36b78ead-e525-4f9e-a34a-37b1683c1a79 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Created reservations ['66a9b8e2-a1e8-4cae-911b-5606a7eec7fb', '9c7f2a82-4287-48d0-8f46-e32fbaf21054', 'aabf0bb9-18d7-4e53-8688-7423b0486711', '8d90d792-f4a7-4ee6-a113-5430b19af928'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:44:44 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-36b78ead-e525-4f9e-a34a-37b1683c1a79 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Delete snapshot completed successfully. Sep 05 11:44:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-36b78ead-e525-4f9e-a34a-37b1683c1a79 tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Lock "cinder-2974ab55-38e0-4814-b3f0-5ecd7beba06f-delete_snapshot" released by "delete_snapshot" :: held 1.865s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:44:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f09ca9d2-ea3d-4507-badb-20a587e977ed tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Acquiring lock "cinder-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:44:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f09ca9d2-ea3d-4507-badb-20a587e977ed tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Lock "cinder-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:44:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f09ca9d2-ea3d-4507-badb-20a587e977ed tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Acquiring lock "cinder-quobyte-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:44:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f09ca9d2-ea3d-4507-badb-20a587e977ed tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Lock "cinder-quobyte-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7" acquired by "delete_volume" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:44:44 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ab98a3-135a-4a6b-bd07-a263dd7061a5]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:44:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f09ca9d2-ea3d-4507-badb-20a587e977ed tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:44 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7 Sep 05 11:44:44 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:45 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f09ca9d2-ea3d-4507-badb-20a587e977ed tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7" returned: 0 in 0.490s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f09ca9d2-ea3d-4507-badb-20a587e977ed tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:45 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7 Sep 05 11:44:45 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:45 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f09ca9d2-ea3d-4507-badb-20a587e977ed tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7" returned: 0 in 0.262s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f09ca9d2-ea3d-4507-badb-20a587e977ed tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Lock "cinder-quobyte-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7" released by "delete_volume" :: held 0.828s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:44:45 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-f09ca9d2-ea3d-4507-badb-20a587e977ed tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Created reservations ['dbe0484d-38ef-4ed6-a76d-3fa6ecdeeca4', '5fed828d-5068-47dc-bd14-c9cc10cf1a52', '49b3822b-c248-4830-8ae0-d48cf39f580c', '77032816-eb96-41a7-9248-9019d05f762d'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:44:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f09ca9d2-ea3d-4507-badb-20a587e977ed tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:44:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f09ca9d2-ea3d-4507-badb-20a587e977ed tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:44:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f09ca9d2-ea3d-4507-badb-20a587e977ed tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:44:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f09ca9d2-ea3d-4507-badb-20a587e977ed tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:44:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f09ca9d2-ea3d-4507-badb-20a587e977ed tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:44:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f09ca9d2-ea3d-4507-badb-20a587e977ed tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:45 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:44:45 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:46 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f09ca9d2-ea3d-4507-badb-20a587e977ed tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.324s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:46 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-f09ca9d2-ea3d-4507-badb-20a587e977ed tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:44:46 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f09ca9d2-ea3d-4507-badb-20a587e977ed tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Deleted volume successfully. Sep 05 11:44:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f09ca9d2-ea3d-4507-badb-20a587e977ed tempest-VolumesSnapshotNegativeTestJSON-1492471621 None] Lock "cinder-e1e0d526-175b-4ebe-a3e8-bbf6f44219e7-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:44:46 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:44:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] Flow 'volume_create_manager' (71017aff-2b2d-427e-9eac-c504d84bf1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:44:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a90923cb-e24b-42b9-a594-90afb294efbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a90923cb-e24b-42b9-a594-90afb294efbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-304879181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41f2d989-df84-4f73-97e6-f29eca219a90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c878f179b2d443908f5e69ae85f6a12d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:44:47Z,use_quota=True,user_id='56a4a548fd774fbd8eddf862e4f2abf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (486d6f62-808f-4d03-bc67-0a4555a0a433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (486d6f62-808f-4d03-bc67-0a4555a0a433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2808ea9d-347a-4eb5-b124-34ba877fb558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2808ea9d-347a-4eb5-b124-34ba877fb558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41f2d989-df84-4f73-97e6-f29eca219a90', 'volume_name': 'volume-41f2d989-df84-4f73-97e6-f29eca219a90', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a09ec11f-bc22-4a09-9cbb-afd69efb9433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a09ec11f-bc22-4a09-9cbb-afd69efb9433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7f8307-cca0-4058-9051-fd4146075e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:47 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] Volume 41f2d989-df84-4f73-97e6-f29eca219a90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41f2d989-df84-4f73-97e6-f29eca219a90', 'volume_size': 1} Sep 05 11:44:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:44:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:44:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-304879181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41f2d989-df84-4f73-97e6-f29eca219a90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c878f179b2d443908f5e69ae85f6a12d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:44:47Z,use_quota=True,user_id='56a4a548fd774fbd8eddf862e4f2abf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:44:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] Creating volume 41f2d989-df84-4f73-97e6-f29eca219a90 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:44:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:44:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:44:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:44:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:44:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:44:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:44:47 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:44:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-41f2d989-df84-4f73-97e6-f29eca219a90 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:47 devstack sudo[100461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-41f2d989-df84-4f73-97e6-f29eca219a90 1073741824 Sep 05 11:44:47 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:47 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-41f2d989-df84-4f73-97e6-f29eca219a90 1073741824" returned: 0 in 0.553s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-41f2d989-df84-4f73-97e6-f29eca219a90 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:47 devstack sudo[100466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-41f2d989-df84-4f73-97e6-f29eca219a90 Sep 05 11:44:47 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:47 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-41f2d989-df84-4f73-97e6-f29eca219a90" returned: 0 in 0.307s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:44:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:44:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7f8307-cca0-4058-9051-fd4146075e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41f2d989-df84-4f73-97e6-f29eca219a90', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e43a24-7591-4436-9224-d17c3255a4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:47 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] Volume volume-41f2d989-df84-4f73-97e6-f29eca219a90 (41f2d989-df84-4f73-97e6-f29eca219a90): created successfully Sep 05 11:44:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e43a24-7591-4436-9224-d17c3255a4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] Flow 'volume_create_manager' (71017aff-2b2d-427e-9eac-c504d84bf1bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:44:48 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-32f3bdc1-acd6-4e3d-8c58-648af1aa7bf8 tempest-AttachVolumeTestJSON-1706745870 None] Created volume successfully. Sep 05 11:44:50 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=111,cinder:UPDATE=103,cinder:INSERT=31,cinder:DELETE=12 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:44:50 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=93,cinder:UPDATE=134,cinder:DELETE=8,cinder:INSERT=23 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:44:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-045d29cd-aca9-4d95-a4a0-ef91945debdf req-eeb1805f-56b4-4f30-a05c-d74478275ca4 tempest-AttachVolumeTestJSON-1706745870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:44:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-045d29cd-aca9-4d95-a4a0-ef91945debdf req-eeb1805f-56b4-4f30-a05c-d74478275ca4 tempest-AttachVolumeTestJSON-1706745870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:44:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-045d29cd-aca9-4d95-a4a0-ef91945debdf req-eeb1805f-56b4-4f30-a05c-d74478275ca4 tempest-AttachVolumeTestJSON-1706745870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:44:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-045d29cd-aca9-4d95-a4a0-ef91945debdf req-eeb1805f-56b4-4f30-a05c-d74478275ca4 tempest-AttachVolumeTestJSON-1706745870 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32', 'name': 'volume-41f2d989-df84-4f73-97e6-f29eca219a90', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '44f6b96d-e263-45b3-a7dd-4ec7c71e9c1f', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 11:44:50 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-045d29cd-aca9-4d95-a4a0-ef91945debdf req-eeb1805f-56b4-4f30-a05c-d74478275ca4 tempest-AttachVolumeTestJSON-1706745870 None] attachment_update completed successfully. Sep 05 11:44:50 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:44:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Flow 'volume_create_manager' (bd6c5402-441d-45cc-815c-ac91745aa54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:44:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a26386b-ca50-47a4-986f-7abec965b624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a26386b-ca50-47a4-986f-7abec965b624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1333388966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce5687e-d140-4de1-9fa0-8076373a50ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92d145d77e8d41fe99b93b42052220fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:44:51Z,use_quota=True,user_id='f286fa48d685494ab4c9ffad729f6a9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4adb16fa-b3cb-40b6-800d-1837f904a995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4adb16fa-b3cb-40b6-800d-1837f904a995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2105c961-93bb-456a-996d-ea0167a4783f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2105c961-93bb-456a-996d-ea0167a4783f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ce5687e-d140-4de1-9fa0-8076373a50ac', 'volume_name': 'volume-6ce5687e-d140-4de1-9fa0-8076373a50ac', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b6d122c-25d9-4dd4-a8d3-18598d10da9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b6d122c-25d9-4dd4-a8d3-18598d10da9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf41725-c93d-473e-9a20-cb49a0098a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:50 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Volume 6ce5687e-d140-4de1-9fa0-8076373a50ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ce5687e-d140-4de1-9fa0-8076373a50ac', 'volume_size': 1} Sep 05 11:44:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:44:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:44:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1333388966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce5687e-d140-4de1-9fa0-8076373a50ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92d145d77e8d41fe99b93b42052220fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:44:51Z,use_quota=True,user_id='f286fa48d685494ab4c9ffad729f6a9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:44:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Creating volume 6ce5687e-d140-4de1-9fa0-8076373a50ac {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:44:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:44:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:44:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:44:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:44:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:44:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:44:50 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:44:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6ce5687e-d140-4de1-9fa0-8076373a50ac 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:50 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6ce5687e-d140-4de1-9fa0-8076373a50ac 1073741824 Sep 05 11:44:50 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:51 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:44:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Flow 'volume_create_manager' (4a97dc4b-aad7-4d82-a636-f0ba1372e1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:44:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (651cb8e6-8634-4777-a037-96d7c151b9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (651cb8e6-8634-4777-a037-96d7c151b9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2058104430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc46fa05-4b24-4639-9f87-42704b6cf4cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92d145d77e8d41fe99b93b42052220fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:44:51Z,use_quota=True,user_id='f286fa48d685494ab4c9ffad729f6a9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1fe4ead-f717-4432-9277-8cdcbbbc4c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1fe4ead-f717-4432-9277-8cdcbbbc4c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a2f8715-9363-4c33-9811-bdaaf6805c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a2f8715-9363-4c33-9811-bdaaf6805c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc46fa05-4b24-4639-9f87-42704b6cf4cd', 'volume_name': 'volume-cc46fa05-4b24-4639-9f87-42704b6cf4cd', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf94b140-8734-467c-a0fb-903890757252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf94b140-8734-467c-a0fb-903890757252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12a3747-c7d6-4266-897f-71f087b245ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:51 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Volume cc46fa05-4b24-4639-9f87-42704b6cf4cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc46fa05-4b24-4639-9f87-42704b6cf4cd', 'volume_size': 1} Sep 05 11:44:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:44:51 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6ce5687e-d140-4de1-9fa0-8076373a50ac 1073741824" returned: 0 in 0.712s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6ce5687e-d140-4de1-9fa0-8076373a50ac {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:51 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6ce5687e-d140-4de1-9fa0-8076373a50ac Sep 05 11:44:51 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:51 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6ce5687e-d140-4de1-9fa0-8076373a50ac" returned: 0 in 0.311s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:44:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:44:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.700s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:44:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2058104430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc46fa05-4b24-4639-9f87-42704b6cf4cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92d145d77e8d41fe99b93b42052220fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:44:51Z,use_quota=True,user_id='f286fa48d685494ab4c9ffad729f6a9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:44:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Creating volume cc46fa05-4b24-4639-9f87-42704b6cf4cd {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:44:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:44:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:44:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:44:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:44:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:44:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:44:51 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:44:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cc46fa05-4b24-4639-9f87-42704b6cf4cd 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf41725-c93d-473e-9a20-cb49a0098a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ce5687e-d140-4de1-9fa0-8076373a50ac', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:51 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cc46fa05-4b24-4639-9f87-42704b6cf4cd 1073741824 Sep 05 11:44:51 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446c9bfc-e381-4151-9236-db98411c77b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:51 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Volume volume-6ce5687e-d140-4de1-9fa0-8076373a50ac (6ce5687e-d140-4de1-9fa0-8076373a50ac): created successfully Sep 05 11:44:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446c9bfc-e381-4151-9236-db98411c77b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Flow 'volume_create_manager' (bd6c5402-441d-45cc-815c-ac91745aa54c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:44:52 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-76f4388c-e9e1-4cea-a729-6389b9a49819 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Created volume successfully. Sep 05 11:44:52 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cc46fa05-4b24-4639-9f87-42704b6cf4cd 1073741824" returned: 0 in 0.659s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cc46fa05-4b24-4639-9f87-42704b6cf4cd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:44:52 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cc46fa05-4b24-4639-9f87-42704b6cf4cd Sep 05 11:44:52 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:44:52 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Sep 05 11:44:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cc46fa05-4b24-4639-9f87-42704b6cf4cd" returned: 0 in 0.367s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:44:52 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:44:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:44:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12a3747-c7d6-4266-897f-71f087b245ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc46fa05-4b24-4639-9f87-42704b6cf4cd', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eac6c92-be9e-4232-867c-f368e2d9c403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:44:53 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Volume volume-cc46fa05-4b24-4639-9f87-42704b6cf4cd (cc46fa05-4b24-4639-9f87-42704b6cf4cd): created successfully Sep 05 11:44:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eac6c92-be9e-4232-867c-f368e2d9c403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:44:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Flow 'volume_create_manager' (4a97dc4b-aad7-4d82-a636-f0ba1372e1eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:44:53 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3fb92dde-49c7-4fe9-afba-ef668bd06fd6 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Created volume successfully. Sep 05 11:44:53 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-100f9ce1-b245-454d-8eac-479b6f8997af req-fd9d297e-8547-44f3-b5f4-b8ef39d0dd3a tempest-AttachVolumeTestJSON-1706745870 None] Terminate volume connection completed successfully. Sep 05 11:44:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-100f9ce1-b245-454d-8eac-479b6f8997af req-fd9d297e-8547-44f3-b5f4-b8ef39d0dd3a tempest-AttachVolumeTestJSON-1706745870 None] Deleting attachment 157457a7-0c81-40e8-887e-873a6a5d12bf. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 11:44:55 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-4a0a9bd0-45de-4bc4-afb0-7b0897f3ca5a req-9a6f40a5-1140-47bc-9ee0-0c2553457bcd tempest-AttachVolumeTestJSON-1706745870 None] Terminate volume connection completed successfully. Sep 05 11:44:55 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-4a0a9bd0-45de-4bc4-afb0-7b0897f3ca5a req-9a6f40a5-1140-47bc-9ee0-0c2553457bcd tempest-AttachVolumeTestJSON-1706745870 None] Deleting attachment 44f6b96d-e263-45b3-a7dd-4ec7c71e9c1f. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 11:45:05 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=11,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:45:05 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=12,cinder:UPDATE=10,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:45:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d8fec45d-1041-4a4e-a064-cf0b0d536798 tempest-AttachVolumeTestJSON-1706745870 None] Acquiring lock "cinder-41f2d989-df84-4f73-97e6-f29eca219a90-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:45:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d8fec45d-1041-4a4e-a064-cf0b0d536798 tempest-AttachVolumeTestJSON-1706745870 None] Lock "cinder-41f2d989-df84-4f73-97e6-f29eca219a90-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:45:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d8fec45d-1041-4a4e-a064-cf0b0d536798 tempest-AttachVolumeTestJSON-1706745870 None] Acquiring lock "cinder-quobyte-41f2d989-df84-4f73-97e6-f29eca219a90" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:45:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d8fec45d-1041-4a4e-a064-cf0b0d536798 tempest-AttachVolumeTestJSON-1706745870 None] Lock "cinder-quobyte-41f2d989-df84-4f73-97e6-f29eca219a90" acquired by "delete_volume" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:45:05 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab06e8c-a74f-4439-a810-2de945e376f2]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:45:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d8fec45d-1041-4a4e-a064-cf0b0d536798 tempest-AttachVolumeTestJSON-1706745870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-41f2d989-df84-4f73-97e6-f29eca219a90 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:05 devstack sudo[100653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-41f2d989-df84-4f73-97e6-f29eca219a90 Sep 05 11:45:05 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:06 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d8fec45d-1041-4a4e-a064-cf0b0d536798 tempest-AttachVolumeTestJSON-1706745870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-41f2d989-df84-4f73-97e6-f29eca219a90" returned: 0 in 0.422s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d8fec45d-1041-4a4e-a064-cf0b0d536798 tempest-AttachVolumeTestJSON-1706745870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-41f2d989-df84-4f73-97e6-f29eca219a90 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:06 devstack sudo[100658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-41f2d989-df84-4f73-97e6-f29eca219a90 Sep 05 11:45:06 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:06 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d8fec45d-1041-4a4e-a064-cf0b0d536798 tempest-AttachVolumeTestJSON-1706745870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-41f2d989-df84-4f73-97e6-f29eca219a90" returned: 0 in 0.268s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d8fec45d-1041-4a4e-a064-cf0b0d536798 tempest-AttachVolumeTestJSON-1706745870 None] Lock "cinder-quobyte-41f2d989-df84-4f73-97e6-f29eca219a90" released by "delete_volume" :: held 0.771s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:45:06 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-d8fec45d-1041-4a4e-a064-cf0b0d536798 tempest-AttachVolumeTestJSON-1706745870 None] Created reservations ['64b0a439-066f-4274-9686-7a097669393b', 'c25b84fe-6ac6-495d-81c5-238d835e1f06', 'ba841219-4d63-4e0c-968c-3830063661f4', 'a086e04c-5bc8-42b8-b31a-f0b8a37b92b6'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:45:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d8fec45d-1041-4a4e-a064-cf0b0d536798 tempest-AttachVolumeTestJSON-1706745870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:45:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d8fec45d-1041-4a4e-a064-cf0b0d536798 tempest-AttachVolumeTestJSON-1706745870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:45:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d8fec45d-1041-4a4e-a064-cf0b0d536798 tempest-AttachVolumeTestJSON-1706745870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:45:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d8fec45d-1041-4a4e-a064-cf0b0d536798 tempest-AttachVolumeTestJSON-1706745870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:45:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d8fec45d-1041-4a4e-a064-cf0b0d536798 tempest-AttachVolumeTestJSON-1706745870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:45:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d8fec45d-1041-4a4e-a064-cf0b0d536798 tempest-AttachVolumeTestJSON-1706745870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:06 devstack sudo[100661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:45:06 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-12fea5a0-4380-46d9-a370-2150e1c4fb67 tempest-AttachVolumeTestJSON-1706745870 None] Acquiring lock "cinder-86914b9c-d631-4345-9d23-d086761b6eb1-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:45:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-12fea5a0-4380-46d9-a370-2150e1c4fb67 tempest-AttachVolumeTestJSON-1706745870 None] Lock "cinder-86914b9c-d631-4345-9d23-d086761b6eb1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:45:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-12fea5a0-4380-46d9-a370-2150e1c4fb67 tempest-AttachVolumeTestJSON-1706745870 None] Acquiring lock "cinder-quobyte-86914b9c-d631-4345-9d23-d086761b6eb1" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:45:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-12fea5a0-4380-46d9-a370-2150e1c4fb67 tempest-AttachVolumeTestJSON-1706745870 None] Lock "cinder-quobyte-86914b9c-d631-4345-9d23-d086761b6eb1" acquired by "delete_volume" :: waited 0.026s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:45:06 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a585d52f-6815-4ba0-8d8c-7876531c2956]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:45:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fea5a0-4380-46d9-a370-2150e1c4fb67 tempest-AttachVolumeTestJSON-1706745870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-86914b9c-d631-4345-9d23-d086761b6eb1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:06 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d8fec45d-1041-4a4e-a064-cf0b0d536798 tempest-AttachVolumeTestJSON-1706745870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.365s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:06 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-d8fec45d-1041-4a4e-a064-cf0b0d536798 tempest-AttachVolumeTestJSON-1706745870 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:45:06 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d8fec45d-1041-4a4e-a064-cf0b0d536798 tempest-AttachVolumeTestJSON-1706745870 None] Deleted volume successfully. Sep 05 11:45:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d8fec45d-1041-4a4e-a064-cf0b0d536798 tempest-AttachVolumeTestJSON-1706745870 None] Lock "cinder-41f2d989-df84-4f73-97e6-f29eca219a90-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:45:06 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-86914b9c-d631-4345-9d23-d086761b6eb1 Sep 05 11:45:06 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:07 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fea5a0-4380-46d9-a370-2150e1c4fb67 tempest-AttachVolumeTestJSON-1706745870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-86914b9c-d631-4345-9d23-d086761b6eb1" returned: 0 in 0.412s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fea5a0-4380-46d9-a370-2150e1c4fb67 tempest-AttachVolumeTestJSON-1706745870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-86914b9c-d631-4345-9d23-d086761b6eb1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:07 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-86914b9c-d631-4345-9d23-d086761b6eb1 Sep 05 11:45:07 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:07 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fea5a0-4380-46d9-a370-2150e1c4fb67 tempest-AttachVolumeTestJSON-1706745870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-86914b9c-d631-4345-9d23-d086761b6eb1" returned: 0 in 0.288s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-12fea5a0-4380-46d9-a370-2150e1c4fb67 tempest-AttachVolumeTestJSON-1706745870 None] Lock "cinder-quobyte-86914b9c-d631-4345-9d23-d086761b6eb1" released by "delete_volume" :: held 0.755s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:45:07 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-12fea5a0-4380-46d9-a370-2150e1c4fb67 tempest-AttachVolumeTestJSON-1706745870 None] Created reservations ['db4a8fb7-d40a-4ff9-9dc2-58ca8efb764a', '622eda73-a685-4476-a405-0ec40d36a964', '896d0c1e-1cfb-4550-96b8-506e8d9af9ee', 'dc95f71a-0728-4559-b1c2-1ef80a0a8f79'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:45:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12fea5a0-4380-46d9-a370-2150e1c4fb67 tempest-AttachVolumeTestJSON-1706745870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:45:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12fea5a0-4380-46d9-a370-2150e1c4fb67 tempest-AttachVolumeTestJSON-1706745870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:45:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-12fea5a0-4380-46d9-a370-2150e1c4fb67 tempest-AttachVolumeTestJSON-1706745870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:45:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-12fea5a0-4380-46d9-a370-2150e1c4fb67 tempest-AttachVolumeTestJSON-1706745870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:45:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12fea5a0-4380-46d9-a370-2150e1c4fb67 tempest-AttachVolumeTestJSON-1706745870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:45:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fea5a0-4380-46d9-a370-2150e1c4fb67 tempest-AttachVolumeTestJSON-1706745870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:07 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:45:07 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b9402019-e164-462d-8d0d-86bde656c40d tempest-AttachVolumeTestJSON-1706745870 None] Acquiring lock "cinder-b0536bbb-2aa0-496b-b986-dcde56ad512c-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:45:08 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12fea5a0-4380-46d9-a370-2150e1c4fb67 tempest-AttachVolumeTestJSON-1706745870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.421s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:08 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-12fea5a0-4380-46d9-a370-2150e1c4fb67 tempest-AttachVolumeTestJSON-1706745870 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:45:08 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-12fea5a0-4380-46d9-a370-2150e1c4fb67 tempest-AttachVolumeTestJSON-1706745870 None] Deleted volume successfully. Sep 05 11:45:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b9402019-e164-462d-8d0d-86bde656c40d tempest-AttachVolumeTestJSON-1706745870 None] Lock "cinder-b0536bbb-2aa0-496b-b986-dcde56ad512c-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:45:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-12fea5a0-4380-46d9-a370-2150e1c4fb67 tempest-AttachVolumeTestJSON-1706745870 None] Lock "cinder-86914b9c-d631-4345-9d23-d086761b6eb1-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:45:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b9402019-e164-462d-8d0d-86bde656c40d tempest-AttachVolumeTestJSON-1706745870 None] Acquiring lock "cinder-quobyte-b0536bbb-2aa0-496b-b986-dcde56ad512c" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:45:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b9402019-e164-462d-8d0d-86bde656c40d tempest-AttachVolumeTestJSON-1706745870 None] Lock "cinder-quobyte-b0536bbb-2aa0-496b-b986-dcde56ad512c" acquired by "delete_volume" :: waited 0.024s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:45:08 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0eaf64-da03-43de-be4e-6323150568ba]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:45:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b9402019-e164-462d-8d0d-86bde656c40d tempest-AttachVolumeTestJSON-1706745870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b0536bbb-2aa0-496b-b986-dcde56ad512c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:08 devstack sudo[100676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b0536bbb-2aa0-496b-b986-dcde56ad512c Sep 05 11:45:08 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:08 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b9402019-e164-462d-8d0d-86bde656c40d tempest-AttachVolumeTestJSON-1706745870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b0536bbb-2aa0-496b-b986-dcde56ad512c" returned: 0 in 0.424s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b9402019-e164-462d-8d0d-86bde656c40d tempest-AttachVolumeTestJSON-1706745870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b0536bbb-2aa0-496b-b986-dcde56ad512c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:08 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b0536bbb-2aa0-496b-b986-dcde56ad512c Sep 05 11:45:08 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:09 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b9402019-e164-462d-8d0d-86bde656c40d tempest-AttachVolumeTestJSON-1706745870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b0536bbb-2aa0-496b-b986-dcde56ad512c" returned: 0 in 0.310s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b9402019-e164-462d-8d0d-86bde656c40d tempest-AttachVolumeTestJSON-1706745870 None] Lock "cinder-quobyte-b0536bbb-2aa0-496b-b986-dcde56ad512c" released by "delete_volume" :: held 0.803s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:45:09 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-b9402019-e164-462d-8d0d-86bde656c40d tempest-AttachVolumeTestJSON-1706745870 None] Created reservations ['403f6279-98c6-458b-bfe8-cf9967ff47e5', '54dcf7f8-c986-4ffe-9398-e835c91a09c6', 'dbb17488-1b13-4274-8b35-1b74e8599607', '4e871a1a-15e8-4a8f-bc87-129ccfc58869'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:45:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b9402019-e164-462d-8d0d-86bde656c40d tempest-AttachVolumeTestJSON-1706745870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:45:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b9402019-e164-462d-8d0d-86bde656c40d tempest-AttachVolumeTestJSON-1706745870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:45:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b9402019-e164-462d-8d0d-86bde656c40d tempest-AttachVolumeTestJSON-1706745870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:45:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b9402019-e164-462d-8d0d-86bde656c40d tempest-AttachVolumeTestJSON-1706745870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:45:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b9402019-e164-462d-8d0d-86bde656c40d tempest-AttachVolumeTestJSON-1706745870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:45:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b9402019-e164-462d-8d0d-86bde656c40d tempest-AttachVolumeTestJSON-1706745870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:09 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:45:09 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:09 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b9402019-e164-462d-8d0d-86bde656c40d tempest-AttachVolumeTestJSON-1706745870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.355s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:09 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-b9402019-e164-462d-8d0d-86bde656c40d tempest-AttachVolumeTestJSON-1706745870 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:45:09 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b9402019-e164-462d-8d0d-86bde656c40d tempest-AttachVolumeTestJSON-1706745870 None] Deleted volume successfully. Sep 05 11:45:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b9402019-e164-462d-8d0d-86bde656c40d tempest-AttachVolumeTestJSON-1706745870 None] Lock "cinder-b0536bbb-2aa0-496b-b986-dcde56ad512c-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:45:18 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:45:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] Flow 'volume_create_manager' (6ad67cbf-98c7-4a28-814c-ba32a60747f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:45:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb8caa74-1569-4ce5-8ef2-4860ec21d035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb8caa74-1569-4ce5-8ef2-4860ec21d035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1898446780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e97f352-6ddd-4613-b8d3-f653577a9f7d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6dab6cd80a5b4f97a46edc89cee73e0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:45:19Z,use_quota=True,user_id='77e0dbfe5cc047b8a1a0d0a56bb93e0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68233997-54fb-4b16-b410-532617c45df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68233997-54fb-4b16-b410-532617c45df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9327fc8-d290-41ac-ab30-5c3843fbe1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9327fc8-d290-41ac-ab30-5c3843fbe1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e97f352-6ddd-4613-b8d3-f653577a9f7d', 'volume_name': 'volume-6e97f352-6ddd-4613-b8d3-f653577a9f7d', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565f7066-e012-459f-b034-f9d2757e4a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565f7066-e012-459f-b034-f9d2757e4a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a6576ff-ced7-4c0e-a788-451e303d2d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:18 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] Volume 6e97f352-6ddd-4613-b8d3-f653577a9f7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e97f352-6ddd-4613-b8d3-f653577a9f7d', 'volume_size': 1} Sep 05 11:45:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:45:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:45:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1898446780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e97f352-6ddd-4613-b8d3-f653577a9f7d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6dab6cd80a5b4f97a46edc89cee73e0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:45:19Z,use_quota=True,user_id='77e0dbfe5cc047b8a1a0d0a56bb93e0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:45:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] Creating volume 6e97f352-6ddd-4613-b8d3-f653577a9f7d {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:45:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:45:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:45:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:45:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:45:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:45:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:45:18 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:45:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6e97f352-6ddd-4613-b8d3-f653577a9f7d 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:18 devstack sudo[100716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6e97f352-6ddd-4613-b8d3-f653577a9f7d 1073741824 Sep 05 11:45:18 devstack sudo[100716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:19 devstack sudo[100716]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6e97f352-6ddd-4613-b8d3-f653577a9f7d 1073741824" returned: 0 in 0.457s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6e97f352-6ddd-4613-b8d3-f653577a9f7d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:19 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6e97f352-6ddd-4613-b8d3-f653577a9f7d Sep 05 11:45:19 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:19 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6e97f352-6ddd-4613-b8d3-f653577a9f7d" returned: 0 in 0.258s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:45:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:45:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a6576ff-ced7-4c0e-a788-451e303d2d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e97f352-6ddd-4613-b8d3-f653577a9f7d', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e1d5e2-a480-4ebe-b709-e99e6d37057e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:19 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] Volume volume-6e97f352-6ddd-4613-b8d3-f653577a9f7d (6e97f352-6ddd-4613-b8d3-f653577a9f7d): created successfully Sep 05 11:45:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e1d5e2-a480-4ebe-b709-e99e6d37057e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] Flow 'volume_create_manager' (6ad67cbf-98c7-4a28-814c-ba32a60747f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:45:19 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-e821499e-bee0-4125-aac9-8d0697024288 req-ebe905e2-61ef-45b4-9829-57950a81e6ad tempest-VolumesGetTestJSON-1292103867 None] Created volume successfully. Sep 05 11:45:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-7ca07bf5-d75f-44d8-9d55-c46551eb642a req-105050db-2c6d-471b-a755-ca10eb1fe724 tempest-VolumesGetTestJSON-1292103867 None] Acquiring lock "cinder-6e97f352-6ddd-4613-b8d3-f653577a9f7d-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:45:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-7ca07bf5-d75f-44d8-9d55-c46551eb642a req-105050db-2c6d-471b-a755-ca10eb1fe724 tempest-VolumesGetTestJSON-1292103867 None] Lock "cinder-6e97f352-6ddd-4613-b8d3-f653577a9f7d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:45:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-7ca07bf5-d75f-44d8-9d55-c46551eb642a req-105050db-2c6d-471b-a755-ca10eb1fe724 tempest-VolumesGetTestJSON-1292103867 None] Acquiring lock "cinder-quobyte-6e97f352-6ddd-4613-b8d3-f653577a9f7d" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:45:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-7ca07bf5-d75f-44d8-9d55-c46551eb642a req-105050db-2c6d-471b-a755-ca10eb1fe724 tempest-VolumesGetTestJSON-1292103867 None] Lock "cinder-quobyte-6e97f352-6ddd-4613-b8d3-f653577a9f7d" acquired by "delete_volume" :: waited 0.024s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:45:20 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ece95c9-12f8-4444-ab02-5963a28ac863]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:45:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-7ca07bf5-d75f-44d8-9d55-c46551eb642a req-105050db-2c6d-471b-a755-ca10eb1fe724 tempest-VolumesGetTestJSON-1292103867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6e97f352-6ddd-4613-b8d3-f653577a9f7d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:20 devstack sudo[100725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6e97f352-6ddd-4613-b8d3-f653577a9f7d Sep 05 11:45:20 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:20 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-7ca07bf5-d75f-44d8-9d55-c46551eb642a req-105050db-2c6d-471b-a755-ca10eb1fe724 tempest-VolumesGetTestJSON-1292103867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6e97f352-6ddd-4613-b8d3-f653577a9f7d" returned: 0 in 0.418s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-7ca07bf5-d75f-44d8-9d55-c46551eb642a req-105050db-2c6d-471b-a755-ca10eb1fe724 tempest-VolumesGetTestJSON-1292103867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6e97f352-6ddd-4613-b8d3-f653577a9f7d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:20 devstack sudo[100730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6e97f352-6ddd-4613-b8d3-f653577a9f7d Sep 05 11:45:20 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:20 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-7ca07bf5-d75f-44d8-9d55-c46551eb642a req-105050db-2c6d-471b-a755-ca10eb1fe724 tempest-VolumesGetTestJSON-1292103867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6e97f352-6ddd-4613-b8d3-f653577a9f7d" returned: 0 in 0.260s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-7ca07bf5-d75f-44d8-9d55-c46551eb642a req-105050db-2c6d-471b-a755-ca10eb1fe724 tempest-VolumesGetTestJSON-1292103867 None] Lock "cinder-quobyte-6e97f352-6ddd-4613-b8d3-f653577a9f7d" released by "delete_volume" :: held 0.723s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:45:21 devstack cinder-volume[87517]: DEBUG cinder.quota [req-7ca07bf5-d75f-44d8-9d55-c46551eb642a req-105050db-2c6d-471b-a755-ca10eb1fe724 tempest-VolumesGetTestJSON-1292103867 None] Created reservations ['1ffc0936-aace-4afc-a9e9-be8bd5c60303', '985b87dd-36e6-4f91-ab46-0a701acead60', 'c32e4de9-266c-4cd1-8800-c03839ec3535', '87ce9f70-2a40-4e3d-af0a-74b6d0aa9f38'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:45:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-7ca07bf5-d75f-44d8-9d55-c46551eb642a req-105050db-2c6d-471b-a755-ca10eb1fe724 tempest-VolumesGetTestJSON-1292103867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:45:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-7ca07bf5-d75f-44d8-9d55-c46551eb642a req-105050db-2c6d-471b-a755-ca10eb1fe724 tempest-VolumesGetTestJSON-1292103867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:45:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-7ca07bf5-d75f-44d8-9d55-c46551eb642a req-105050db-2c6d-471b-a755-ca10eb1fe724 tempest-VolumesGetTestJSON-1292103867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:45:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [req-7ca07bf5-d75f-44d8-9d55-c46551eb642a req-105050db-2c6d-471b-a755-ca10eb1fe724 tempest-VolumesGetTestJSON-1292103867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:45:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-7ca07bf5-d75f-44d8-9d55-c46551eb642a req-105050db-2c6d-471b-a755-ca10eb1fe724 tempest-VolumesGetTestJSON-1292103867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:45:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-7ca07bf5-d75f-44d8-9d55-c46551eb642a req-105050db-2c6d-471b-a755-ca10eb1fe724 tempest-VolumesGetTestJSON-1292103867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:21 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:45:21 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:21 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [req-7ca07bf5-d75f-44d8-9d55-c46551eb642a req-105050db-2c6d-471b-a755-ca10eb1fe724 tempest-VolumesGetTestJSON-1292103867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.279s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:21 devstack cinder-volume[87517]: DEBUG cinder.manager [req-7ca07bf5-d75f-44d8-9d55-c46551eb642a req-105050db-2c6d-471b-a755-ca10eb1fe724 tempest-VolumesGetTestJSON-1292103867 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:45:21 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-7ca07bf5-d75f-44d8-9d55-c46551eb642a req-105050db-2c6d-471b-a755-ca10eb1fe724 tempest-VolumesGetTestJSON-1292103867 None] Deleted volume successfully. Sep 05 11:45:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [req-7ca07bf5-d75f-44d8-9d55-c46551eb642a req-105050db-2c6d-471b-a755-ca10eb1fe724 tempest-VolumesGetTestJSON-1292103867 None] Lock "cinder-6e97f352-6ddd-4613-b8d3-f653577a9f7d-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:45:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c903e78a-5e8f-4133-bcb7-68f0277a66e5 tempest-BackendsCapabilitiesAdminTestsJSON-898238946 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6866188049316, 'free_capacity_gb': 1773.6866188049316, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87517) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 05 11:45:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-af7bdc5f-37c9-40c5-857a-f53e94984a4f tempest-BackendsCapabilitiesAdminTestsJSON-898238946 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6866188049316, 'free_capacity_gb': 1773.6866188049316, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87517) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 05 11:45:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-55b1d4fe-e3da-4dad-889b-2aae0527126c req-2bfbd3aa-9c57-48de-9990-3f5da079151c tempest-TestServerVolumeAttachmentScenario-1435666983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:45:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-55b1d4fe-e3da-4dad-889b-2aae0527126c req-2bfbd3aa-9c57-48de-9990-3f5da079151c tempest-TestServerVolumeAttachmentScenario-1435666983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:45:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-55b1d4fe-e3da-4dad-889b-2aae0527126c req-2bfbd3aa-9c57-48de-9990-3f5da079151c tempest-TestServerVolumeAttachmentScenario-1435666983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:45:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-55b1d4fe-e3da-4dad-889b-2aae0527126c req-2bfbd3aa-9c57-48de-9990-3f5da079151c tempest-TestServerVolumeAttachmentScenario-1435666983 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32', 'name': 'volume-6ce5687e-d140-4de1-9fa0-8076373a50ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c88a8b00-2393-4432-ad0d-aa4432508e2f', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 11:45:30 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-55b1d4fe-e3da-4dad-889b-2aae0527126c req-2bfbd3aa-9c57-48de-9990-3f5da079151c tempest-TestServerVolumeAttachmentScenario-1435666983 None] attachment_update completed successfully. Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:32 devstack sudo[101286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:45:32 devstack sudo[101286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] Flow 'volume_create_manager' (ba7d8220-0518-4639-9755-11edcbd69ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5043dd-f378-4ac3-9df4-dc1340435d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5043dd-f378-4ac3-9df4-dc1340435d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-828946328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc4522b-b9bd-423f-adaf-ed76a236f8e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55c020497742478784c1118bfc79e825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:45:32Z,use_quota=True,user_id='61dd80b2fc7e4ab0874b2d3507eb2cdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f559612c-e2cc-4ba4-a262-c68743fa5117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f559612c-e2cc-4ba4-a262-c68743fa5117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cee82b5d-13dd-4a89-a806-e0381336856b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cee82b5d-13dd-4a89-a806-e0381336856b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bc4522b-b9bd-423f-adaf-ed76a236f8e1', 'volume_name': 'volume-7bc4522b-b9bd-423f-adaf-ed76a236f8e1', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb3e081-a218-4007-8ed8-59ab769e423e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb3e081-a218-4007-8ed8-59ab769e423e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd87d088-1751-42b9-8086-6cbe94dc80d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:32 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] Volume 7bc4522b-b9bd-423f-adaf-ed76a236f8e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bc4522b-b9bd-423f-adaf-ed76a236f8e1', 'volume_size': 1} Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-828946328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc4522b-b9bd-423f-adaf-ed76a236f8e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55c020497742478784c1118bfc79e825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:45:32Z,use_quota=True,user_id='61dd80b2fc7e4ab0874b2d3507eb2cdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] Creating volume 7bc4522b-b9bd-423f-adaf-ed76a236f8e1 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:45:32 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7bc4522b-b9bd-423f-adaf-ed76a236f8e1 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:32 devstack sudo[101288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7bc4522b-b9bd-423f-adaf-ed76a236f8e1 1073741824 Sep 05 11:45:32 devstack sudo[101288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:32 devstack sudo[101286]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.502s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread count: 28 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 11:45:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread info: [<_MainThread(MainThread, started 131707869511808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 11:45:33 devstack sudo[101288]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7bc4522b-b9bd-423f-adaf-ed76a236f8e1 1073741824" returned: 0 in 0.553s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7bc4522b-b9bd-423f-adaf-ed76a236f8e1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:33 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7bc4522b-b9bd-423f-adaf-ed76a236f8e1 Sep 05 11:45:33 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:33 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7bc4522b-b9bd-423f-adaf-ed76a236f8e1" returned: 0 in 0.335s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:45:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:45:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd87d088-1751-42b9-8086-6cbe94dc80d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bc4522b-b9bd-423f-adaf-ed76a236f8e1', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f0b2206-2c5e-49c2-a12b-a91fb7ac366e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:33 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] Volume volume-7bc4522b-b9bd-423f-adaf-ed76a236f8e1 (7bc4522b-b9bd-423f-adaf-ed76a236f8e1): created successfully Sep 05 11:45:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f0b2206-2c5e-49c2-a12b-a91fb7ac366e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] Flow 'volume_create_manager' (ba7d8220-0518-4639-9755-11edcbd69ff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:45:33 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-38ed09fe-251e-45a9-a04f-440af81b9727 tempest-TestMinimumBasicScenario-999348880 None] Created volume successfully. Sep 05 11:45:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-b19e0cef-abf9-44ce-b69f-46b4b8558af6 req-b3de91f5-1095-4b5c-a815-e98a6d2eccaf tempest-TestMinimumBasicScenario-999348880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:45:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-b19e0cef-abf9-44ce-b69f-46b4b8558af6 req-b3de91f5-1095-4b5c-a815-e98a6d2eccaf tempest-TestMinimumBasicScenario-999348880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:45:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-b19e0cef-abf9-44ce-b69f-46b4b8558af6 req-b3de91f5-1095-4b5c-a815-e98a6d2eccaf tempest-TestMinimumBasicScenario-999348880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:45:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-b19e0cef-abf9-44ce-b69f-46b4b8558af6 req-b3de91f5-1095-4b5c-a815-e98a6d2eccaf tempest-TestMinimumBasicScenario-999348880 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32', 'name': 'volume-7bc4522b-b9bd-423f-adaf-ed76a236f8e1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd7b8c22f-6ede-419a-9b3f-8ead79497c4c', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 11:45:35 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-b19e0cef-abf9-44ce-b69f-46b4b8558af6 req-b3de91f5-1095-4b5c-a815-e98a6d2eccaf tempest-TestMinimumBasicScenario-999348880 None] attachment_update completed successfully. Sep 05 11:45:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-be9ac8f7-96d2-49a8-ae1d-628af9d39d3e req-265140eb-0bb3-4e60-9073-bbc45a1cd4c4 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:45:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-be9ac8f7-96d2-49a8-ae1d-628af9d39d3e req-265140eb-0bb3-4e60-9073-bbc45a1cd4c4 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:45:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-be9ac8f7-96d2-49a8-ae1d-628af9d39d3e req-265140eb-0bb3-4e60-9073-bbc45a1cd4c4 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:45:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-be9ac8f7-96d2-49a8-ae1d-628af9d39d3e req-265140eb-0bb3-4e60-9073-bbc45a1cd4c4 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32', 'name': 'volume-cc46fa05-4b24-4639-9f87-42704b6cf4cd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '35d899aa-329a-4195-9f92-62751b8db4b1', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 11:45:38 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-be9ac8f7-96d2-49a8-ae1d-628af9d39d3e req-265140eb-0bb3-4e60-9073-bbc45a1cd4c4 tempest-TestServerVolumeAttachmentScenario-1435666983 None] attachment_update completed successfully. Sep 05 11:45:41 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-910d3f8a-c9ff-43a0-9f31-d30748dbbaf8 req-20226edf-3858-480a-a41d-5291c06bb058 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Terminate volume connection completed successfully. Sep 05 11:45:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-910d3f8a-c9ff-43a0-9f31-d30748dbbaf8 req-20226edf-3858-480a-a41d-5291c06bb058 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Deleting attachment 35d899aa-329a-4195-9f92-62751b8db4b1. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 11:45:42 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-4d6f676c-fc16-40ee-b689-bda6c44e82b2 req-9bdc6f55-e050-4304-aa47-064a1e679b7a tempest-TestServerVolumeAttachmentScenario-1435666983 None] Terminate volume connection completed successfully. Sep 05 11:45:42 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-4d6f676c-fc16-40ee-b689-bda6c44e82b2 req-9bdc6f55-e050-4304-aa47-064a1e679b7a tempest-TestServerVolumeAttachmentScenario-1435666983 None] Deleting attachment c88a8b00-2393-4432-ad0d-aa4432508e2f. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 11:45:43 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:45:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] Flow 'volume_create_manager' (615d9519-5563-49c8-a12e-14c13d0cc9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:45:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b781d7-960c-4024-ab47-77dc4ba620b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b781d7-960c-4024-ab47-77dc4ba620b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2022033334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e2f17a4-9537-4818-b0dd-78a9a0ca3867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a789a841d624d948daf87a6cc09544b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:45:43Z,use_quota=True,user_id='f430459ffb6d455798f48fe8771854ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ded4039-3728-4403-a5c1-31beef5caaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ded4039-3728-4403-a5c1-31beef5caaf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d9a762-51bc-4b62-b014-b8bd85c580fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d9a762-51bc-4b62-b014-b8bd85c580fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e2f17a4-9537-4818-b0dd-78a9a0ca3867', 'volume_name': 'volume-1e2f17a4-9537-4818-b0dd-78a9a0ca3867', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a5916b-4612-4af8-a2c2-19079c0f5d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a5916b-4612-4af8-a2c2-19079c0f5d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90829ac8-1c40-4a5d-8bf4-191fcf52cc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:43 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] Volume 1e2f17a4-9537-4818-b0dd-78a9a0ca3867: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e2f17a4-9537-4818-b0dd-78a9a0ca3867', 'volume_size': 1} Sep 05 11:45:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:45:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:45:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2022033334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e2f17a4-9537-4818-b0dd-78a9a0ca3867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a789a841d624d948daf87a6cc09544b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:45:43Z,use_quota=True,user_id='f430459ffb6d455798f48fe8771854ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:45:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] Creating volume 1e2f17a4-9537-4818-b0dd-78a9a0ca3867 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:45:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:45:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:45:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:45:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:45:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:45:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:45:43 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:45:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1e2f17a4-9537-4818-b0dd-78a9a0ca3867 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:43 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1e2f17a4-9537-4818-b0dd-78a9a0ca3867 1073741824 Sep 05 11:45:43 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:44 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1e2f17a4-9537-4818-b0dd-78a9a0ca3867 1073741824" returned: 0 in 0.565s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1e2f17a4-9537-4818-b0dd-78a9a0ca3867 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:44 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1e2f17a4-9537-4818-b0dd-78a9a0ca3867 Sep 05 11:45:44 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:44 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1e2f17a4-9537-4818-b0dd-78a9a0ca3867" returned: 0 in 0.450s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:45:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:45:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90829ac8-1c40-4a5d-8bf4-191fcf52cc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e2f17a4-9537-4818-b0dd-78a9a0ca3867', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06784597-7a9a-4d44-9e53-b90ccf062d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:44 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] Volume volume-1e2f17a4-9537-4818-b0dd-78a9a0ca3867 (1e2f17a4-9537-4818-b0dd-78a9a0ca3867): created successfully Sep 05 11:45:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06784597-7a9a-4d44-9e53-b90ccf062d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] Flow 'volume_create_manager' (615d9519-5563-49c8-a12e-14c13d0cc9d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:45:44 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f0292b7c-1e18-486a-820c-f4b0289c7395 tempest-VolumesListAdminTestJSON-2105191049 None] Created volume successfully. Sep 05 11:45:46 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:45:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] Flow 'volume_create_manager' (cfd0fb45-2bd3-4d8d-ba56-a1cf6cb838c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:45:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8820f77-133d-4072-944d-971f6928af14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8820f77-133d-4072-944d-971f6928af14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-842098863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11c5859a-b1bb-4a09-9c71-8276045dcbe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a789a841d624d948daf87a6cc09544b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:45:46Z,use_quota=True,user_id='f430459ffb6d455798f48fe8771854ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abcebdb6-9ada-4c88-856b-8ae197c710f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abcebdb6-9ada-4c88-856b-8ae197c710f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d77ec702-2b24-4b13-9760-3d1189b6034f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d77ec702-2b24-4b13-9760-3d1189b6034f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11c5859a-b1bb-4a09-9c71-8276045dcbe8', 'volume_name': 'volume-11c5859a-b1bb-4a09-9c71-8276045dcbe8', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7668baf4-0138-4ed8-938d-43e6dc5e0a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7668baf4-0138-4ed8-938d-43e6dc5e0a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b991867b-b670-4017-b83f-b852f99cf037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:46 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] Volume 11c5859a-b1bb-4a09-9c71-8276045dcbe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11c5859a-b1bb-4a09-9c71-8276045dcbe8', 'volume_size': 1} Sep 05 11:45:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:45:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:45:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-842098863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11c5859a-b1bb-4a09-9c71-8276045dcbe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a789a841d624d948daf87a6cc09544b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:45:46Z,use_quota=True,user_id='f430459ffb6d455798f48fe8771854ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:45:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] Creating volume 11c5859a-b1bb-4a09-9c71-8276045dcbe8 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:45:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:45:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:45:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:45:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:45:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:45:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:45:46 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:45:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-11c5859a-b1bb-4a09-9c71-8276045dcbe8 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:46 devstack sudo[101411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-11c5859a-b1bb-4a09-9c71-8276045dcbe8 1073741824 Sep 05 11:45:46 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:46 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-11c5859a-b1bb-4a09-9c71-8276045dcbe8 1073741824" returned: 0 in 0.452s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-11c5859a-b1bb-4a09-9c71-8276045dcbe8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:46 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-11c5859a-b1bb-4a09-9c71-8276045dcbe8 Sep 05 11:45:46 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:47 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-11c5859a-b1bb-4a09-9c71-8276045dcbe8" returned: 0 in 0.314s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:45:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:45:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b991867b-b670-4017-b83f-b852f99cf037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11c5859a-b1bb-4a09-9c71-8276045dcbe8', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2503970-f3fb-4928-b890-caa25ab811ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:47 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] Volume volume-11c5859a-b1bb-4a09-9c71-8276045dcbe8 (11c5859a-b1bb-4a09-9c71-8276045dcbe8): created successfully Sep 05 11:45:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2503970-f3fb-4928-b890-caa25ab811ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] Flow 'volume_create_manager' (cfd0fb45-2bd3-4d8d-ba56-a1cf6cb838c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:45:47 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-00036955-98b9-4839-9470-7296684536b5 tempest-VolumesListAdminTestJSON-2105191049 None] Created volume successfully. Sep 05 11:45:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fa4b64dd-447c-4a71-8feb-5120c93c0403 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Acquiring lock "cinder-cc46fa05-4b24-4639-9f87-42704b6cf4cd-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:45:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fa4b64dd-447c-4a71-8feb-5120c93c0403 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Lock "cinder-cc46fa05-4b24-4639-9f87-42704b6cf4cd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:45:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fa4b64dd-447c-4a71-8feb-5120c93c0403 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Acquiring lock "cinder-quobyte-cc46fa05-4b24-4639-9f87-42704b6cf4cd" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:45:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fa4b64dd-447c-4a71-8feb-5120c93c0403 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Lock "cinder-quobyte-cc46fa05-4b24-4639-9f87-42704b6cf4cd" acquired by "delete_volume" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:45:47 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[970e9621-91df-4d67-8d34-aa048dd304b4]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:45:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fa4b64dd-447c-4a71-8feb-5120c93c0403 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cc46fa05-4b24-4639-9f87-42704b6cf4cd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:47 devstack sudo[101421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cc46fa05-4b24-4639-9f87-42704b6cf4cd Sep 05 11:45:47 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:48 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fa4b64dd-447c-4a71-8feb-5120c93c0403 tempest-TestServerVolumeAttachmentScenario-1435666983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cc46fa05-4b24-4639-9f87-42704b6cf4cd" returned: 0 in 0.388s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fa4b64dd-447c-4a71-8feb-5120c93c0403 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cc46fa05-4b24-4639-9f87-42704b6cf4cd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:48 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cc46fa05-4b24-4639-9f87-42704b6cf4cd Sep 05 11:45:48 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:48 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fa4b64dd-447c-4a71-8feb-5120c93c0403 tempest-TestServerVolumeAttachmentScenario-1435666983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cc46fa05-4b24-4639-9f87-42704b6cf4cd" returned: 0 in 0.293s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fa4b64dd-447c-4a71-8feb-5120c93c0403 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Lock "cinder-quobyte-cc46fa05-4b24-4639-9f87-42704b6cf4cd" released by "delete_volume" :: held 0.721s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:45:48 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-fa4b64dd-447c-4a71-8feb-5120c93c0403 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Created reservations ['3c3c96ce-e1c9-4fa9-bf60-adc2a59a78d6', 'db32723e-14f4-4692-82a0-73bbab033133', '017cf597-3f7a-4cd2-966b-8f1a2a8e5c5c', 'a1d94e50-6410-4e18-b35c-edd8316e117f'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:45:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fa4b64dd-447c-4a71-8feb-5120c93c0403 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:45:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fa4b64dd-447c-4a71-8feb-5120c93c0403 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:45:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fa4b64dd-447c-4a71-8feb-5120c93c0403 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:45:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fa4b64dd-447c-4a71-8feb-5120c93c0403 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:45:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fa4b64dd-447c-4a71-8feb-5120c93c0403 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:45:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fa4b64dd-447c-4a71-8feb-5120c93c0403 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:48 devstack sudo[101430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:45:48 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-40b91b59-e46d-4221-a905-2e0daeb8cc36 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Acquiring lock "cinder-6ce5687e-d140-4de1-9fa0-8076373a50ac-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:45:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-40b91b59-e46d-4221-a905-2e0daeb8cc36 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Lock "cinder-6ce5687e-d140-4de1-9fa0-8076373a50ac-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:45:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-40b91b59-e46d-4221-a905-2e0daeb8cc36 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Acquiring lock "cinder-quobyte-6ce5687e-d140-4de1-9fa0-8076373a50ac" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:45:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-40b91b59-e46d-4221-a905-2e0daeb8cc36 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Lock "cinder-quobyte-6ce5687e-d140-4de1-9fa0-8076373a50ac" acquired by "delete_volume" :: waited 0.034s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:45:49 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fa4b64dd-447c-4a71-8feb-5120c93c0403 tempest-TestServerVolumeAttachmentScenario-1435666983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.420s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-fa4b64dd-447c-4a71-8feb-5120c93c0403 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5358399-3a46-4943-a1fa-b345c03520c0]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-40b91b59-e46d-4221-a905-2e0daeb8cc36 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6ce5687e-d140-4de1-9fa0-8076373a50ac {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:49 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-fa4b64dd-447c-4a71-8feb-5120c93c0403 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Deleted volume successfully. Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] Flow 'volume_create_manager' (38be203b-6245-4095-81b9-3b7eb51fa908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (241e7a50-65e7-4722-ba0b-9ca17b616f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fa4b64dd-447c-4a71-8feb-5120c93c0403 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Lock "cinder-cc46fa05-4b24-4639-9f87-42704b6cf4cd-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (241e7a50-65e7-4722-ba0b-9ca17b616f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-148096412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bafb833-54a0-4af7-b21d-504ef4c3ff7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a789a841d624d948daf87a6cc09544b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:45:49Z,use_quota=True,user_id='f430459ffb6d455798f48fe8771854ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (496cce23-a3ca-49d6-9373-431a53df2917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (496cce23-a3ca-49d6-9373-431a53df2917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c2bd26f-7e4c-4137-a82b-d7af19ee0c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c2bd26f-7e4c-4137-a82b-d7af19ee0c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bafb833-54a0-4af7-b21d-504ef4c3ff7a', 'volume_name': 'volume-9bafb833-54a0-4af7-b21d-504ef4c3ff7a', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:49 devstack sudo[101433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6ce5687e-d140-4de1-9fa0-8076373a50ac Sep 05 11:45:49 devstack sudo[101433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (316b0f4e-dc3e-4980-8b9a-8180fe0bc85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (316b0f4e-dc3e-4980-8b9a-8180fe0bc85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02db74f7-1ac5-4b65-9166-4057b12af453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:49 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] Volume 9bafb833-54a0-4af7-b21d-504ef4c3ff7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bafb833-54a0-4af7-b21d-504ef4c3ff7a', 'volume_size': 1} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-148096412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bafb833-54a0-4af7-b21d-504ef4c3ff7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a789a841d624d948daf87a6cc09544b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:45:49Z,use_quota=True,user_id='f430459ffb6d455798f48fe8771854ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] Creating volume 9bafb833-54a0-4af7-b21d-504ef4c3ff7a {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:45:49 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9bafb833-54a0-4af7-b21d-504ef4c3ff7a 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:49 devstack sudo[101435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9bafb833-54a0-4af7-b21d-504ef4c3ff7a 1073741824 Sep 05 11:45:49 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:49 devstack sudo[101433]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-40b91b59-e46d-4221-a905-2e0daeb8cc36 tempest-TestServerVolumeAttachmentScenario-1435666983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6ce5687e-d140-4de1-9fa0-8076373a50ac" returned: 0 in 0.404s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-40b91b59-e46d-4221-a905-2e0daeb8cc36 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6ce5687e-d140-4de1-9fa0-8076373a50ac {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:49 devstack sudo[101442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6ce5687e-d140-4de1-9fa0-8076373a50ac Sep 05 11:45:49 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:49 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9bafb833-54a0-4af7-b21d-504ef4c3ff7a 1073741824" returned: 0 in 0.451s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9bafb833-54a0-4af7-b21d-504ef4c3ff7a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:49 devstack sudo[101447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9bafb833-54a0-4af7-b21d-504ef4c3ff7a Sep 05 11:45:49 devstack sudo[101447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:49 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-40b91b59-e46d-4221-a905-2e0daeb8cc36 tempest-TestServerVolumeAttachmentScenario-1435666983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6ce5687e-d140-4de1-9fa0-8076373a50ac" returned: 0 in 0.297s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-40b91b59-e46d-4221-a905-2e0daeb8cc36 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Lock "cinder-quobyte-6ce5687e-d140-4de1-9fa0-8076373a50ac" released by "delete_volume" :: held 0.779s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-40b91b59-e46d-4221-a905-2e0daeb8cc36 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Created reservations ['8c20c0e5-5ec8-467b-8e7a-587e50ea4e07', '882671da-0672-4a4b-b677-6ceef0d59fb7', 'b80ed1b1-dfd2-40fb-b7f2-62c6e4d0d029', '1ce03c07-a742-43a1-a566-17dd03c9e8f1'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-40b91b59-e46d-4221-a905-2e0daeb8cc36 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-40b91b59-e46d-4221-a905-2e0daeb8cc36 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-40b91b59-e46d-4221-a905-2e0daeb8cc36 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-40b91b59-e46d-4221-a905-2e0daeb8cc36 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-40b91b59-e46d-4221-a905-2e0daeb8cc36 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:45:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-40b91b59-e46d-4221-a905-2e0daeb8cc36 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:49 devstack sudo[101449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:45:49 devstack sudo[101449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:50 devstack sudo[101447]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9bafb833-54a0-4af7-b21d-504ef4c3ff7a" returned: 0 in 0.306s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:45:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:45:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02db74f7-1ac5-4b65-9166-4057b12af453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bafb833-54a0-4af7-b21d-504ef4c3ff7a', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7835c926-795a-492e-8582-1220fe6693c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:50 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] Volume volume-9bafb833-54a0-4af7-b21d-504ef4c3ff7a (9bafb833-54a0-4af7-b21d-504ef4c3ff7a): created successfully Sep 05 11:45:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7835c926-795a-492e-8582-1220fe6693c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] Flow 'volume_create_manager' (38be203b-6245-4095-81b9-3b7eb51fa908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:45:50 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-85ad7244-8148-4480-b319-d401fe0cd463 tempest-VolumesListAdminTestJSON-2105191049 None] Created volume successfully. Sep 05 11:45:50 devstack sudo[101449]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-40b91b59-e46d-4221-a905-2e0daeb8cc36 tempest-TestServerVolumeAttachmentScenario-1435666983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.279s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:50 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-40b91b59-e46d-4221-a905-2e0daeb8cc36 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:45:50 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-40b91b59-e46d-4221-a905-2e0daeb8cc36 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Deleted volume successfully. Sep 05 11:45:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-40b91b59-e46d-4221-a905-2e0daeb8cc36 tempest-TestServerVolumeAttachmentScenario-1435666983 None] Lock "cinder-6ce5687e-d140-4de1-9fa0-8076373a50ac-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:45:51 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:45:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] Flow 'volume_create_manager' (91f7871b-8b8c-43c4-a9ff-47311af8208e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:45:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (935cdae1-700d-48d7-84bf-7bcc5dbdec3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (935cdae1-700d-48d7-84bf-7bcc5dbdec3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cab5f29c-b39f-4945-be48-5d50b2f2bbf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d51b6bf5bacc4abfb7a907aa912c6e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:45:52Z,use_quota=True,user_id='580bd7a475e34f97b290a156cf517916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (629a6623-476f-4d68-9222-b28e93cc86af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (629a6623-476f-4d68-9222-b28e93cc86af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30d625a5-858a-47d6-8cff-2723dce6f140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30d625a5-858a-47d6-8cff-2723dce6f140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cab5f29c-b39f-4945-be48-5d50b2f2bbf3', 'volume_name': 'volume-cab5f29c-b39f-4945-be48-5d50b2f2bbf3', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (232c7d8a-582c-41f1-adaa-108c6fc2865d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (232c7d8a-582c-41f1-adaa-108c6fc2865d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f83335bd-b1cd-4874-94cc-aeb5b5871863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:52 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] Volume cab5f29c-b39f-4945-be48-5d50b2f2bbf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cab5f29c-b39f-4945-be48-5d50b2f2bbf3', 'volume_size': 1} Sep 05 11:45:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:45:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:45:52 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cab5f29c-b39f-4945-be48-5d50b2f2bbf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d51b6bf5bacc4abfb7a907aa912c6e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:45:52Z,use_quota=True,user_id='580bd7a475e34f97b290a156cf517916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:45:52 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] Creating volume cab5f29c-b39f-4945-be48-5d50b2f2bbf3 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:45:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:45:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:45:52 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:45:52 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:45:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:45:52 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:45:52 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:45:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cab5f29c-b39f-4945-be48-5d50b2f2bbf3 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:52 devstack sudo[101487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cab5f29c-b39f-4945-be48-5d50b2f2bbf3 1073741824 Sep 05 11:45:52 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:52 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cab5f29c-b39f-4945-be48-5d50b2f2bbf3 1073741824" returned: 0 in 0.485s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cab5f29c-b39f-4945-be48-5d50b2f2bbf3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:52 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cab5f29c-b39f-4945-be48-5d50b2f2bbf3 Sep 05 11:45:52 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:52 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cab5f29c-b39f-4945-be48-5d50b2f2bbf3" returned: 0 in 0.291s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:52 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:45:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:45:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f83335bd-b1cd-4874-94cc-aeb5b5871863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cab5f29c-b39f-4945-be48-5d50b2f2bbf3', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d34e3279-9be7-4f52-bd28-2f3cf3b77561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:45:52 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] Volume volume-cab5f29c-b39f-4945-be48-5d50b2f2bbf3 (cab5f29c-b39f-4945-be48-5d50b2f2bbf3): created successfully Sep 05 11:45:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d34e3279-9be7-4f52-bd28-2f3cf3b77561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:45:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] Flow 'volume_create_manager' (91f7871b-8b8c-43c4-a9ff-47311af8208e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:45:52 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c09f5c6a-ccff-4505-81db-7ba1d4dcc458 tempest-VolumesListAdminTestJSON-1541007003 None] Created volume successfully. Sep 05 11:45:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3fb69a0f-4688-44ed-adb6-761c7732f7a6 tempest-VolumesListAdminTestJSON-1541007003 None] Acquiring lock "cinder-cab5f29c-b39f-4945-be48-5d50b2f2bbf3-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:45:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3fb69a0f-4688-44ed-adb6-761c7732f7a6 tempest-VolumesListAdminTestJSON-1541007003 None] Lock "cinder-cab5f29c-b39f-4945-be48-5d50b2f2bbf3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:45:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3fb69a0f-4688-44ed-adb6-761c7732f7a6 tempest-VolumesListAdminTestJSON-1541007003 None] Acquiring lock "cinder-quobyte-cab5f29c-b39f-4945-be48-5d50b2f2bbf3" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:45:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3fb69a0f-4688-44ed-adb6-761c7732f7a6 tempest-VolumesListAdminTestJSON-1541007003 None] Lock "cinder-quobyte-cab5f29c-b39f-4945-be48-5d50b2f2bbf3" acquired by "delete_volume" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:45:54 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e3a02a-7add-48f5-b189-1f345baf8196]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:45:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3fb69a0f-4688-44ed-adb6-761c7732f7a6 tempest-VolumesListAdminTestJSON-1541007003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cab5f29c-b39f-4945-be48-5d50b2f2bbf3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-08f506c3-4889-493e-96e5-06743a542490 tempest-VolumesListAdminTestJSON-2105191049 None] Acquiring lock "cinder-9bafb833-54a0-4af7-b21d-504ef4c3ff7a-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:45:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-08f506c3-4889-493e-96e5-06743a542490 tempest-VolumesListAdminTestJSON-2105191049 None] Lock "cinder-9bafb833-54a0-4af7-b21d-504ef4c3ff7a-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:45:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-08f506c3-4889-493e-96e5-06743a542490 tempest-VolumesListAdminTestJSON-2105191049 None] Acquiring lock "cinder-quobyte-9bafb833-54a0-4af7-b21d-504ef4c3ff7a" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:45:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-08f506c3-4889-493e-96e5-06743a542490 tempest-VolumesListAdminTestJSON-2105191049 None] Lock "cinder-quobyte-9bafb833-54a0-4af7-b21d-504ef4c3ff7a" acquired by "delete_volume" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:45:54 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ce48be-9641-4389-ba2c-38928f1f36fe]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:45:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-08f506c3-4889-493e-96e5-06743a542490 tempest-VolumesListAdminTestJSON-2105191049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9bafb833-54a0-4af7-b21d-504ef4c3ff7a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:54 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cab5f29c-b39f-4945-be48-5d50b2f2bbf3 Sep 05 11:45:54 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:54 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9bafb833-54a0-4af7-b21d-504ef4c3ff7a Sep 05 11:45:54 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:54 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3fb69a0f-4688-44ed-adb6-761c7732f7a6 tempest-VolumesListAdminTestJSON-1541007003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cab5f29c-b39f-4945-be48-5d50b2f2bbf3" returned: 0 in 0.555s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3fb69a0f-4688-44ed-adb6-761c7732f7a6 tempest-VolumesListAdminTestJSON-1541007003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cab5f29c-b39f-4945-be48-5d50b2f2bbf3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:54 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cab5f29c-b39f-4945-be48-5d50b2f2bbf3 Sep 05 11:45:54 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:54 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-08f506c3-4889-493e-96e5-06743a542490 tempest-VolumesListAdminTestJSON-2105191049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9bafb833-54a0-4af7-b21d-504ef4c3ff7a" returned: 0 in 0.478s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-08f506c3-4889-493e-96e5-06743a542490 tempest-VolumesListAdminTestJSON-2105191049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9bafb833-54a0-4af7-b21d-504ef4c3ff7a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:55 devstack sudo[101514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9bafb833-54a0-4af7-b21d-504ef4c3ff7a Sep 05 11:45:55 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:55 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3fb69a0f-4688-44ed-adb6-761c7732f7a6 tempest-VolumesListAdminTestJSON-1541007003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cab5f29c-b39f-4945-be48-5d50b2f2bbf3" returned: 0 in 0.290s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3fb69a0f-4688-44ed-adb6-761c7732f7a6 tempest-VolumesListAdminTestJSON-1541007003 None] Lock "cinder-quobyte-cab5f29c-b39f-4945-be48-5d50b2f2bbf3" released by "delete_volume" :: held 0.940s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:45:55 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-3fb69a0f-4688-44ed-adb6-761c7732f7a6 tempest-VolumesListAdminTestJSON-1541007003 None] Created reservations ['f14c20e4-675c-401a-8390-6960576dabf2', '22587373-2b64-48ab-9148-0a48e1d9ae46', '63cfec16-6859-45d5-be7f-b6ed45e64fc8', '6e5ff6d2-7991-44c3-a851-4a59aff8805a'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:45:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3fb69a0f-4688-44ed-adb6-761c7732f7a6 tempest-VolumesListAdminTestJSON-1541007003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:45:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3fb69a0f-4688-44ed-adb6-761c7732f7a6 tempest-VolumesListAdminTestJSON-1541007003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:45:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3fb69a0f-4688-44ed-adb6-761c7732f7a6 tempest-VolumesListAdminTestJSON-1541007003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:45:55 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3fb69a0f-4688-44ed-adb6-761c7732f7a6 tempest-VolumesListAdminTestJSON-1541007003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:45:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3fb69a0f-4688-44ed-adb6-761c7732f7a6 tempest-VolumesListAdminTestJSON-1541007003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:45:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3fb69a0f-4688-44ed-adb6-761c7732f7a6 tempest-VolumesListAdminTestJSON-1541007003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-08f506c3-4889-493e-96e5-06743a542490 tempest-VolumesListAdminTestJSON-2105191049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9bafb833-54a0-4af7-b21d-504ef4c3ff7a" returned: 0 in 0.301s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-08f506c3-4889-493e-96e5-06743a542490 tempest-VolumesListAdminTestJSON-2105191049 None] Lock "cinder-quobyte-9bafb833-54a0-4af7-b21d-504ef4c3ff7a" released by "delete_volume" :: held 0.852s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:45:55 devstack sudo[101523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:45:55 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:55 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-08f506c3-4889-493e-96e5-06743a542490 tempest-VolumesListAdminTestJSON-2105191049 None] Created reservations ['37d9ba57-5280-4ad3-a41f-e9bf27fcd474', '7ab0abb4-7b49-416d-b78c-9a7871162259', '539a5620-769c-4fe8-9204-5583cc26cf3f', '5a101e87-a0ec-4b78-9d36-7bb5167e285e'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:45:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-08f506c3-4889-493e-96e5-06743a542490 tempest-VolumesListAdminTestJSON-2105191049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:45:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-08f506c3-4889-493e-96e5-06743a542490 tempest-VolumesListAdminTestJSON-2105191049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:45:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-08f506c3-4889-493e-96e5-06743a542490 tempest-VolumesListAdminTestJSON-2105191049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:45:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-08f506c3-4889-493e-96e5-06743a542490 tempest-VolumesListAdminTestJSON-2105191049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:45:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-08f506c3-4889-493e-96e5-06743a542490 tempest-VolumesListAdminTestJSON-2105191049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:45:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-08f506c3-4889-493e-96e5-06743a542490 tempest-VolumesListAdminTestJSON-2105191049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:55 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:45:55 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b9ba9a07-335d-4be0-bc53-0e21d184baba tempest-VolumesListAdminTestJSON-2105191049 None] Acquiring lock "cinder-11c5859a-b1bb-4a09-9c71-8276045dcbe8-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:45:55 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3fb69a0f-4688-44ed-adb6-761c7732f7a6 tempest-VolumesListAdminTestJSON-1541007003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.473s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:55 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-3fb69a0f-4688-44ed-adb6-761c7732f7a6 tempest-VolumesListAdminTestJSON-1541007003 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:45:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b9ba9a07-335d-4be0-bc53-0e21d184baba tempest-VolumesListAdminTestJSON-2105191049 None] Lock "cinder-11c5859a-b1bb-4a09-9c71-8276045dcbe8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:45:55 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3fb69a0f-4688-44ed-adb6-761c7732f7a6 tempest-VolumesListAdminTestJSON-1541007003 None] Deleted volume successfully. Sep 05 11:45:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3fb69a0f-4688-44ed-adb6-761c7732f7a6 tempest-VolumesListAdminTestJSON-1541007003 None] Lock "cinder-cab5f29c-b39f-4945-be48-5d50b2f2bbf3-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:45:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b9ba9a07-335d-4be0-bc53-0e21d184baba tempest-VolumesListAdminTestJSON-2105191049 None] Acquiring lock "cinder-quobyte-11c5859a-b1bb-4a09-9c71-8276045dcbe8" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:45:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b9ba9a07-335d-4be0-bc53-0e21d184baba tempest-VolumesListAdminTestJSON-2105191049 None] Lock "cinder-quobyte-11c5859a-b1bb-4a09-9c71-8276045dcbe8" acquired by "delete_volume" :: waited 0.024s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:45:55 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-08f506c3-4889-493e-96e5-06743a542490 tempest-VolumesListAdminTestJSON-2105191049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.407s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:55 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-08f506c3-4889-493e-96e5-06743a542490 tempest-VolumesListAdminTestJSON-2105191049 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:45:55 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24bf6aa-0e9b-4567-b475-6d2bde8664d9]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:45:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b9ba9a07-335d-4be0-bc53-0e21d184baba tempest-VolumesListAdminTestJSON-2105191049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-11c5859a-b1bb-4a09-9c71-8276045dcbe8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:55 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-08f506c3-4889-493e-96e5-06743a542490 tempest-VolumesListAdminTestJSON-2105191049 None] Deleted volume successfully. Sep 05 11:45:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-08f506c3-4889-493e-96e5-06743a542490 tempest-VolumesListAdminTestJSON-2105191049 None] Lock "cinder-9bafb833-54a0-4af7-b21d-504ef4c3ff7a-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:45:56 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-11c5859a-b1bb-4a09-9c71-8276045dcbe8 Sep 05 11:45:56 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:56 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b9ba9a07-335d-4be0-bc53-0e21d184baba tempest-VolumesListAdminTestJSON-2105191049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-11c5859a-b1bb-4a09-9c71-8276045dcbe8" returned: 0 in 0.480s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b9ba9a07-335d-4be0-bc53-0e21d184baba tempest-VolumesListAdminTestJSON-2105191049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-11c5859a-b1bb-4a09-9c71-8276045dcbe8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:56 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-11c5859a-b1bb-4a09-9c71-8276045dcbe8 Sep 05 11:45:56 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:56 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b9ba9a07-335d-4be0-bc53-0e21d184baba tempest-VolumesListAdminTestJSON-2105191049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-11c5859a-b1bb-4a09-9c71-8276045dcbe8" returned: 0 in 0.306s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b9ba9a07-335d-4be0-bc53-0e21d184baba tempest-VolumesListAdminTestJSON-2105191049 None] Lock "cinder-quobyte-11c5859a-b1bb-4a09-9c71-8276045dcbe8" released by "delete_volume" :: held 0.844s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:45:56 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-b9ba9a07-335d-4be0-bc53-0e21d184baba tempest-VolumesListAdminTestJSON-2105191049 None] Created reservations ['534f7cf4-e33d-4dda-9021-864a67a600b9', 'b3edba23-e427-4cb4-9502-d04e6b20a623', '7c8f82aa-5256-4712-9705-e897b01d579a', 'acf7d849-54b5-410a-b261-8d7d3ddf0155'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:45:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b9ba9a07-335d-4be0-bc53-0e21d184baba tempest-VolumesListAdminTestJSON-2105191049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:45:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b9ba9a07-335d-4be0-bc53-0e21d184baba tempest-VolumesListAdminTestJSON-2105191049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:45:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b9ba9a07-335d-4be0-bc53-0e21d184baba tempest-VolumesListAdminTestJSON-2105191049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:45:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b9ba9a07-335d-4be0-bc53-0e21d184baba tempest-VolumesListAdminTestJSON-2105191049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:45:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b9ba9a07-335d-4be0-bc53-0e21d184baba tempest-VolumesListAdminTestJSON-2105191049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:45:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b9ba9a07-335d-4be0-bc53-0e21d184baba tempest-VolumesListAdminTestJSON-2105191049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:56 devstack sudo[101557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:45:56 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4a05b21e-da35-459b-b1f9-73a7b978d1ae tempest-VolumesListAdminTestJSON-2105191049 None] Acquiring lock "cinder-1e2f17a4-9537-4818-b0dd-78a9a0ca3867-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:45:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4a05b21e-da35-459b-b1f9-73a7b978d1ae tempest-VolumesListAdminTestJSON-2105191049 None] Lock "cinder-1e2f17a4-9537-4818-b0dd-78a9a0ca3867-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:45:57 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b9ba9a07-335d-4be0-bc53-0e21d184baba tempest-VolumesListAdminTestJSON-2105191049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.295s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:57 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-b9ba9a07-335d-4be0-bc53-0e21d184baba tempest-VolumesListAdminTestJSON-2105191049 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:45:57 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b9ba9a07-335d-4be0-bc53-0e21d184baba tempest-VolumesListAdminTestJSON-2105191049 None] Deleted volume successfully. Sep 05 11:45:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4a05b21e-da35-459b-b1f9-73a7b978d1ae tempest-VolumesListAdminTestJSON-2105191049 None] Acquiring lock "cinder-quobyte-1e2f17a4-9537-4818-b0dd-78a9a0ca3867" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:45:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4a05b21e-da35-459b-b1f9-73a7b978d1ae tempest-VolumesListAdminTestJSON-2105191049 None] Lock "cinder-quobyte-1e2f17a4-9537-4818-b0dd-78a9a0ca3867" acquired by "delete_volume" :: waited 0.029s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:45:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b9ba9a07-335d-4be0-bc53-0e21d184baba tempest-VolumesListAdminTestJSON-2105191049 None] Lock "cinder-11c5859a-b1bb-4a09-9c71-8276045dcbe8-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:45:57 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2791cc76-4b11-4b6c-a5e7-2b7bb95e304d]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:45:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4a05b21e-da35-459b-b1f9-73a7b978d1ae tempest-VolumesListAdminTestJSON-2105191049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1e2f17a4-9537-4818-b0dd-78a9a0ca3867 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:57 devstack sudo[101560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1e2f17a4-9537-4818-b0dd-78a9a0ca3867 Sep 05 11:45:57 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:57 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4a05b21e-da35-459b-b1f9-73a7b978d1ae tempest-VolumesListAdminTestJSON-2105191049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1e2f17a4-9537-4818-b0dd-78a9a0ca3867" returned: 0 in 0.457s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4a05b21e-da35-459b-b1f9-73a7b978d1ae tempest-VolumesListAdminTestJSON-2105191049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1e2f17a4-9537-4818-b0dd-78a9a0ca3867 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:57 devstack sudo[101565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1e2f17a4-9537-4818-b0dd-78a9a0ca3867 Sep 05 11:45:57 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:58 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4a05b21e-da35-459b-b1f9-73a7b978d1ae tempest-VolumesListAdminTestJSON-2105191049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1e2f17a4-9537-4818-b0dd-78a9a0ca3867" returned: 0 in 0.292s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4a05b21e-da35-459b-b1f9-73a7b978d1ae tempest-VolumesListAdminTestJSON-2105191049 None] Lock "cinder-quobyte-1e2f17a4-9537-4818-b0dd-78a9a0ca3867" released by "delete_volume" :: held 0.807s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:45:58 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-4a05b21e-da35-459b-b1f9-73a7b978d1ae tempest-VolumesListAdminTestJSON-2105191049 None] Created reservations ['9d1bda6f-97c8-44b2-84bd-38ad99e4604a', '36e803d8-422a-412b-aff2-a91d5d41556c', 'fe5322e4-5362-4639-b9c7-06b0134eddd2', 'eca43f0a-9d81-4867-a56e-ce2c5a76a171'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:45:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4a05b21e-da35-459b-b1f9-73a7b978d1ae tempest-VolumesListAdminTestJSON-2105191049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:45:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4a05b21e-da35-459b-b1f9-73a7b978d1ae tempest-VolumesListAdminTestJSON-2105191049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:45:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4a05b21e-da35-459b-b1f9-73a7b978d1ae tempest-VolumesListAdminTestJSON-2105191049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:45:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4a05b21e-da35-459b-b1f9-73a7b978d1ae tempest-VolumesListAdminTestJSON-2105191049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:45:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4a05b21e-da35-459b-b1f9-73a7b978d1ae tempest-VolumesListAdminTestJSON-2105191049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:45:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4a05b21e-da35-459b-b1f9-73a7b978d1ae tempest-VolumesListAdminTestJSON-2105191049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:45:58 devstack sudo[101568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:45:58 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:45:58 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root Sep 05 11:45:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4a05b21e-da35-459b-b1f9-73a7b978d1ae tempest-VolumesListAdminTestJSON-2105191049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.301s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:45:58 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-4a05b21e-da35-459b-b1f9-73a7b978d1ae tempest-VolumesListAdminTestJSON-2105191049 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:45:58 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-4a05b21e-da35-459b-b1f9-73a7b978d1ae tempest-VolumesListAdminTestJSON-2105191049 None] Deleted volume successfully. Sep 05 11:45:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4a05b21e-da35-459b-b1f9-73a7b978d1ae tempest-VolumesListAdminTestJSON-2105191049 None] Lock "cinder-1e2f17a4-9537-4818-b0dd-78a9a0ca3867-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:46:07 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=102,cinder:SELECT=85,cinder:INSERT=23,cinder:DELETE=8 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:46:07 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=84,cinder:INSERT=23,cinder:UPDATE=105,cinder:DELETE=8 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:46:07 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:46:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] Flow 'volume_create_manager' (d2012539-7289-4e41-b7fe-88d72ed49ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:46:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26de1391-7e0a-4d72-8a82-f947d8c54fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26de1391-7e0a-4d72-8a82-f947d8c54fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1794287019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26ec4902-20ac-4b0c-8f13-7dbd63af0163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec840e11022499fa1abec2768c9e2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:46:08Z,use_quota=True,user_id='4df630a32d534a12b7a056409e36132e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e80b6fbf-5eb1-46e9-88f6-05fccc9c1146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e80b6fbf-5eb1-46e9-88f6-05fccc9c1146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ebd2b9c-9ece-4db4-91a2-fbf372bd8148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ebd2b9c-9ece-4db4-91a2-fbf372bd8148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26ec4902-20ac-4b0c-8f13-7dbd63af0163', 'volume_name': 'volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d5fb8e-3156-43b3-8b93-8b4540c6835a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d5fb8e-3156-43b3-8b93-8b4540c6835a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (650d0c15-2d6d-4fed-ac02-fb61cabccc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:07 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] Volume 26ec4902-20ac-4b0c-8f13-7dbd63af0163: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163', 'volume_size': 1} Sep 05 11:46:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:46:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:46:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1794287019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26ec4902-20ac-4b0c-8f13-7dbd63af0163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec840e11022499fa1abec2768c9e2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:46:08Z,use_quota=True,user_id='4df630a32d534a12b7a056409e36132e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:46:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] Creating volume 26ec4902-20ac-4b0c-8f13-7dbd63af0163 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:46:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:46:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:46:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:46:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:46:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:46:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:46:07 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:46:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:07 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163 1073741824 Sep 05 11:46:07 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:08 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163 1073741824" returned: 0 in 0.461s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:08 devstack sudo[101579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163 Sep 05 11:46:08 devstack sudo[101579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:08 devstack sudo[101579]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163" returned: 0 in 0.502s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:46:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:46:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (650d0c15-2d6d-4fed-ac02-fb61cabccc5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfef32e0-7029-410f-9228-f8afe9d98965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:08 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] Volume volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163 (26ec4902-20ac-4b0c-8f13-7dbd63af0163): created successfully Sep 05 11:46:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfef32e0-7029-410f-9228-f8afe9d98965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] Flow 'volume_create_manager' (d2012539-7289-4e41-b7fe-88d72ed49ab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:46:08 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-97528914-feef-41b1-9bf0-4f06b61e31ab tempest-SnapshotMetadataTestJSON-1821277690 None] Created volume successfully. Sep 05 11:46:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bfcf2b77-1890-4f78-89f0-80838d159c8c tempest-SnapshotMetadataTestJSON-1821277690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:46:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bfcf2b77-1890-4f78-89f0-80838d159c8c tempest-SnapshotMetadataTestJSON-1821277690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:46:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-bfcf2b77-1890-4f78-89f0-80838d159c8c tempest-SnapshotMetadataTestJSON-1821277690 None] Creating offline snapshot e0715ed1-7963-4fd8-9606-e420fc75bc4c of volume 26ec4902-20ac-4b0c-8f13-7dbd63af0163 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:46:10 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[233ef491-56d0-4d88-923d-b9623bb15d8b]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:46:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bfcf2b77-1890-4f78-89f0-80838d159c8c tempest-SnapshotMetadataTestJSON-1821277690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:10 devstack sudo[101592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163 Sep 05 11:46:10 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:10 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bfcf2b77-1890-4f78-89f0-80838d159c8c tempest-SnapshotMetadataTestJSON-1821277690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163" returned: 0 in 0.370s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bfcf2b77-1890-4f78-89f0-80838d159c8c tempest-SnapshotMetadataTestJSON-1821277690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163.e0715ed1-7963-4fd8-9606-e420fc75bc4c 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:10 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163.e0715ed1-7963-4fd8-9606-e420fc75bc4c 1G Sep 05 11:46:10 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:10 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bfcf2b77-1890-4f78-89f0-80838d159c8c tempest-SnapshotMetadataTestJSON-1821277690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163.e0715ed1-7963-4fd8-9606-e420fc75bc4c 1G" returned: 0 in 0.412s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bfcf2b77-1890-4f78-89f0-80838d159c8c tempest-SnapshotMetadataTestJSON-1821277690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163.e0715ed1-7963-4fd8-9606-e420fc75bc4c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:10 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163.e0715ed1-7963-4fd8-9606-e420fc75bc4c Sep 05 11:46:10 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:11 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bfcf2b77-1890-4f78-89f0-80838d159c8c tempest-SnapshotMetadataTestJSON-1821277690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163.e0715ed1-7963-4fd8-9606-e420fc75bc4c" returned: 0 in 0.345s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:11 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-bfcf2b77-1890-4f78-89f0-80838d159c8c tempest-SnapshotMetadataTestJSON-1821277690 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163.e0715ed1-7963-4fd8-9606-e420fc75bc4c is being set with open permissions: ugo+rw Sep 05 11:46:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bfcf2b77-1890-4f78-89f0-80838d159c8c tempest-SnapshotMetadataTestJSON-1821277690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163.e0715ed1-7963-4fd8-9606-e420fc75bc4c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:11 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163.e0715ed1-7963-4fd8-9606-e420fc75bc4c Sep 05 11:46:11 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:11 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bfcf2b77-1890-4f78-89f0-80838d159c8c tempest-SnapshotMetadataTestJSON-1821277690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163.e0715ed1-7963-4fd8-9606-e420fc75bc4c" returned: 0 in 0.280s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bfcf2b77-1890-4f78-89f0-80838d159c8c tempest-SnapshotMetadataTestJSON-1821277690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:11 devstack sudo[101612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163.info Sep 05 11:46:11 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:11 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bfcf2b77-1890-4f78-89f0-80838d159c8c tempest-SnapshotMetadataTestJSON-1821277690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163.info" returned: 0 in 0.252s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:11 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-bfcf2b77-1890-4f78-89f0-80838d159c8c tempest-SnapshotMetadataTestJSON-1821277690 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163.info is being set with open permissions: ugo+rw Sep 05 11:46:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bfcf2b77-1890-4f78-89f0-80838d159c8c tempest-SnapshotMetadataTestJSON-1821277690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:11 devstack sudo[101615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163.info Sep 05 11:46:11 devstack sudo[101615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:12 devstack sudo[101615]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bfcf2b77-1890-4f78-89f0-80838d159c8c tempest-SnapshotMetadataTestJSON-1821277690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163.info" returned: 0 in 0.250s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bfcf2b77-1890-4f78-89f0-80838d159c8c tempest-SnapshotMetadataTestJSON-1821277690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:46:12 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-bfcf2b77-1890-4f78-89f0-80838d159c8c tempest-SnapshotMetadataTestJSON-1821277690 None] Create snapshot completed successfully Sep 05 11:46:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bbb30e49-16e6-48a2-a9b2-c3502fa11464 tempest-SnapshotMetadataTestJSON-1821277690 None] Acquiring lock "cinder-e0715ed1-7963-4fd8-9606-e420fc75bc4c-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:46:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bbb30e49-16e6-48a2-a9b2-c3502fa11464 tempest-SnapshotMetadataTestJSON-1821277690 None] Lock "cinder-e0715ed1-7963-4fd8-9606-e420fc75bc4c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:46:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bbb30e49-16e6-48a2-a9b2-c3502fa11464 tempest-SnapshotMetadataTestJSON-1821277690 None] Acquiring lock "cinder-quobyte-26ec4902-20ac-4b0c-8f13-7dbd63af0163" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:46:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bbb30e49-16e6-48a2-a9b2-c3502fa11464 tempest-SnapshotMetadataTestJSON-1821277690 None] Lock "cinder-quobyte-26ec4902-20ac-4b0c-8f13-7dbd63af0163" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:46:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bbb30e49-16e6-48a2-a9b2-c3502fa11464 tempest-SnapshotMetadataTestJSON-1821277690 None] Acquiring lock "cinder-quobyte-e0715ed1-7963-4fd8-9606-e420fc75bc4c" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:46:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bbb30e49-16e6-48a2-a9b2-c3502fa11464 tempest-SnapshotMetadataTestJSON-1821277690 None] Lock "cinder-quobyte-e0715ed1-7963-4fd8-9606-e420fc75bc4c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:46:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-bbb30e49-16e6-48a2-a9b2-c3502fa11464 tempest-SnapshotMetadataTestJSON-1821277690 None] Deleting offline snapshot e0715ed1-7963-4fd8-9606-e420fc75bc4c of volume 26ec4902-20ac-4b0c-8f13-7dbd63af0163 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:46:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-bbb30e49-16e6-48a2-a9b2-c3502fa11464 tempest-SnapshotMetadataTestJSON-1821277690 None] snapshot_file for this snap is: volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163.e0715ed1-7963-4fd8-9606-e420fc75bc4c {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:46:13 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0897e527-73d2-4d39-be65-0582dd82131b]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:46:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bbb30e49-16e6-48a2-a9b2-c3502fa11464 tempest-SnapshotMetadataTestJSON-1821277690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163.e0715ed1-7963-4fd8-9606-e420fc75bc4c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:13 devstack sudo[101619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163.e0715ed1-7963-4fd8-9606-e420fc75bc4c Sep 05 11:46:13 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:13 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bbb30e49-16e6-48a2-a9b2-c3502fa11464 tempest-SnapshotMetadataTestJSON-1821277690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163.e0715ed1-7963-4fd8-9606-e420fc75bc4c" returned: 0 in 0.383s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-bbb30e49-16e6-48a2-a9b2-c3502fa11464 tempest-SnapshotMetadataTestJSON-1821277690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:46:13 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45f0c83-e5ac-4f87-9780-0e6d5973c9bf]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:46:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bbb30e49-16e6-48a2-a9b2-c3502fa11464 tempest-SnapshotMetadataTestJSON-1821277690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:13 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163 Sep 05 11:46:13 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:13 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bbb30e49-16e6-48a2-a9b2-c3502fa11464 tempest-SnapshotMetadataTestJSON-1821277690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163" returned: 0 in 0.378s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bbb30e49-16e6-48a2-a9b2-c3502fa11464 tempest-SnapshotMetadataTestJSON-1821277690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163.e0715ed1-7963-4fd8-9606-e420fc75bc4c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:13 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163.e0715ed1-7963-4fd8-9606-e420fc75bc4c Sep 05 11:46:13 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:14 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bbb30e49-16e6-48a2-a9b2-c3502fa11464 tempest-SnapshotMetadataTestJSON-1821277690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163.e0715ed1-7963-4fd8-9606-e420fc75bc4c" returned: 0 in 0.409s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bbb30e49-16e6-48a2-a9b2-c3502fa11464 tempest-SnapshotMetadataTestJSON-1821277690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163.e0715ed1-7963-4fd8-9606-e420fc75bc4c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:14 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163.e0715ed1-7963-4fd8-9606-e420fc75bc4c Sep 05 11:46:14 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:14 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bbb30e49-16e6-48a2-a9b2-c3502fa11464 tempest-SnapshotMetadataTestJSON-1821277690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163.e0715ed1-7963-4fd8-9606-e420fc75bc4c" returned: 0 in 0.277s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bbb30e49-16e6-48a2-a9b2-c3502fa11464 tempest-SnapshotMetadataTestJSON-1821277690 None] Lock "cinder-quobyte-e0715ed1-7963-4fd8-9606-e420fc75bc4c" released by "_delete_snapshot" :: held 1.572s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:46:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bbb30e49-16e6-48a2-a9b2-c3502fa11464 tempest-SnapshotMetadataTestJSON-1821277690 None] Lock "cinder-quobyte-26ec4902-20ac-4b0c-8f13-7dbd63af0163" released by "delete_snapshot" :: held 1.598s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:46:14 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-bbb30e49-16e6-48a2-a9b2-c3502fa11464 tempest-SnapshotMetadataTestJSON-1821277690 None] Created reservations ['10c43a00-8189-4782-9fc9-d34a59a76e51', '5ba85b0d-187b-4b47-b9cc-49bfca9cb773', 'ca1fec7d-7a09-4c67-a853-1a6a5ea7eb05', '8350f7d3-ac56-490d-87cc-ea00d38b29d8'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:46:14 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-bbb30e49-16e6-48a2-a9b2-c3502fa11464 tempest-SnapshotMetadataTestJSON-1821277690 None] Delete snapshot completed successfully. Sep 05 11:46:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bbb30e49-16e6-48a2-a9b2-c3502fa11464 tempest-SnapshotMetadataTestJSON-1821277690 None] Lock "cinder-e0715ed1-7963-4fd8-9606-e420fc75bc4c-delete_snapshot" released by "delete_snapshot" :: held 1.775s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:46:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ede23431-e209-4200-bc8d-9a6a32a6c13f tempest-SnapshotMetadataTestJSON-1821277690 None] Acquiring lock "cinder-26ec4902-20ac-4b0c-8f13-7dbd63af0163-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:46:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ede23431-e209-4200-bc8d-9a6a32a6c13f tempest-SnapshotMetadataTestJSON-1821277690 None] Lock "cinder-26ec4902-20ac-4b0c-8f13-7dbd63af0163-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:46:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ede23431-e209-4200-bc8d-9a6a32a6c13f tempest-SnapshotMetadataTestJSON-1821277690 None] Acquiring lock "cinder-quobyte-26ec4902-20ac-4b0c-8f13-7dbd63af0163" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:46:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ede23431-e209-4200-bc8d-9a6a32a6c13f tempest-SnapshotMetadataTestJSON-1821277690 None] Lock "cinder-quobyte-26ec4902-20ac-4b0c-8f13-7dbd63af0163" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:46:15 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0714ecf9-e577-4f2b-8434-21a7f32596a5]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:46:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ede23431-e209-4200-bc8d-9a6a32a6c13f tempest-SnapshotMetadataTestJSON-1821277690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:15 devstack sudo[101638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163 Sep 05 11:46:15 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:15 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ede23431-e209-4200-bc8d-9a6a32a6c13f tempest-SnapshotMetadataTestJSON-1821277690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163" returned: 0 in 0.390s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ede23431-e209-4200-bc8d-9a6a32a6c13f tempest-SnapshotMetadataTestJSON-1821277690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:15 devstack sudo[101643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163 Sep 05 11:46:15 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:16 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ede23431-e209-4200-bc8d-9a6a32a6c13f tempest-SnapshotMetadataTestJSON-1821277690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-26ec4902-20ac-4b0c-8f13-7dbd63af0163" returned: 0 in 0.262s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ede23431-e209-4200-bc8d-9a6a32a6c13f tempest-SnapshotMetadataTestJSON-1821277690 None] Lock "cinder-quobyte-26ec4902-20ac-4b0c-8f13-7dbd63af0163" released by "delete_volume" :: held 0.717s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:46:16 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-ede23431-e209-4200-bc8d-9a6a32a6c13f tempest-SnapshotMetadataTestJSON-1821277690 None] Created reservations ['526e7901-77a4-4992-aed6-20681beb9867', '522794d3-518c-455a-80bb-20ebd5d5d9b5', '24c32ec5-d453-4433-b948-6ed317890723', '7a6c1588-b091-42b1-bb79-9addeb82992c'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:46:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ede23431-e209-4200-bc8d-9a6a32a6c13f tempest-SnapshotMetadataTestJSON-1821277690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:46:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ede23431-e209-4200-bc8d-9a6a32a6c13f tempest-SnapshotMetadataTestJSON-1821277690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:46:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ede23431-e209-4200-bc8d-9a6a32a6c13f tempest-SnapshotMetadataTestJSON-1821277690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:46:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ede23431-e209-4200-bc8d-9a6a32a6c13f tempest-SnapshotMetadataTestJSON-1821277690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:46:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ede23431-e209-4200-bc8d-9a6a32a6c13f tempest-SnapshotMetadataTestJSON-1821277690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:46:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ede23431-e209-4200-bc8d-9a6a32a6c13f tempest-SnapshotMetadataTestJSON-1821277690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:16 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:46:16 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:16 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ede23431-e209-4200-bc8d-9a6a32a6c13f tempest-SnapshotMetadataTestJSON-1821277690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.343s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:16 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-ede23431-e209-4200-bc8d-9a6a32a6c13f tempest-SnapshotMetadataTestJSON-1821277690 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:46:16 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ede23431-e209-4200-bc8d-9a6a32a6c13f tempest-SnapshotMetadataTestJSON-1821277690 None] Deleted volume successfully. Sep 05 11:46:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ede23431-e209-4200-bc8d-9a6a32a6c13f tempest-SnapshotMetadataTestJSON-1821277690 None] Lock "cinder-26ec4902-20ac-4b0c-8f13-7dbd63af0163-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:46:22 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:46:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] Flow 'volume_create_manager' (e3062cd9-ed31-4157-8a40-42bb0fa2e0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:46:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9aa7200-c500-462b-8a82-edaffa7b135f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9aa7200-c500-462b-8a82-edaffa7b135f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-537095240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb711c63-5e99-440a-bf4d-4b1ceba9b6d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff67b3c58b04e03ae77fa35a220e0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:46:22Z,use_quota=True,user_id='5cca7febc86d4f489ec1cb6919539686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d18c790c-84f3-4b82-9178-dd8398d4349a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d18c790c-84f3-4b82-9178-dd8398d4349a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (016325e6-1b26-40fb-8b94-ab496141783c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (016325e6-1b26-40fb-8b94-ab496141783c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb711c63-5e99-440a-bf4d-4b1ceba9b6d6', 'volume_name': 'volume-eb711c63-5e99-440a-bf4d-4b1ceba9b6d6', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea9395d8-7a28-435b-a78f-fb3bf0efb05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea9395d8-7a28-435b-a78f-fb3bf0efb05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9badd6f-a1b0-4870-b683-99cb9b2af65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:22 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] Volume eb711c63-5e99-440a-bf4d-4b1ceba9b6d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb711c63-5e99-440a-bf4d-4b1ceba9b6d6', 'volume_size': 1} Sep 05 11:46:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:46:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:46:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-537095240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb711c63-5e99-440a-bf4d-4b1ceba9b6d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff67b3c58b04e03ae77fa35a220e0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:46:22Z,use_quota=True,user_id='5cca7febc86d4f489ec1cb6919539686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:46:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] Creating volume eb711c63-5e99-440a-bf4d-4b1ceba9b6d6 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:46:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:46:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:46:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:46:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:46:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:46:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:46:22 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:46:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eb711c63-5e99-440a-bf4d-4b1ceba9b6d6 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:22 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eb711c63-5e99-440a-bf4d-4b1ceba9b6d6 1073741824 Sep 05 11:46:22 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:23 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eb711c63-5e99-440a-bf4d-4b1ceba9b6d6 1073741824" returned: 0 in 0.677s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eb711c63-5e99-440a-bf4d-4b1ceba9b6d6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:23 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eb711c63-5e99-440a-bf4d-4b1ceba9b6d6 Sep 05 11:46:23 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:23 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-7feeae7a-fb4f-4ecc-ac9b-e39c3684e896 req-ea9f2a9b-eb2f-4819-a205-694ae578d23e tempest-TestMinimumBasicScenario-999348880 None] Terminate volume connection completed successfully. Sep 05 11:46:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-7feeae7a-fb4f-4ecc-ac9b-e39c3684e896 req-ea9f2a9b-eb2f-4819-a205-694ae578d23e tempest-TestMinimumBasicScenario-999348880 None] Deleting attachment d7b8c22f-6ede-419a-9b3f-8ead79497c4c. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 11:46:23 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eb711c63-5e99-440a-bf4d-4b1ceba9b6d6" returned: 0 in 0.337s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:46:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:46:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9badd6f-a1b0-4870-b683-99cb9b2af65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb711c63-5e99-440a-bf4d-4b1ceba9b6d6', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18be63a7-8fc8-44c0-95ed-7caa1330f6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:23 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] Volume volume-eb711c63-5e99-440a-bf4d-4b1ceba9b6d6 (eb711c63-5e99-440a-bf4d-4b1ceba9b6d6): created successfully Sep 05 11:46:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18be63a7-8fc8-44c0-95ed-7caa1330f6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] Flow 'volume_create_manager' (e3062cd9-ed31-4157-8a40-42bb0fa2e0f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:46:23 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-18ecbc24-ae3d-4308-bde7-617be1527a06 tempest-VolumesTransfersTest-743137284 None] Created volume successfully. Sep 05 11:46:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bb00d3fb-42dc-4c82-a1aa-c81f3b4939c0 tempest-TestMinimumBasicScenario-999348880 None] Acquiring lock "cinder-7bc4522b-b9bd-423f-adaf-ed76a236f8e1-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:46:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bb00d3fb-42dc-4c82-a1aa-c81f3b4939c0 tempest-TestMinimumBasicScenario-999348880 None] Lock "cinder-7bc4522b-b9bd-423f-adaf-ed76a236f8e1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:46:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bb00d3fb-42dc-4c82-a1aa-c81f3b4939c0 tempest-TestMinimumBasicScenario-999348880 None] Acquiring lock "cinder-quobyte-7bc4522b-b9bd-423f-adaf-ed76a236f8e1" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:46:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bb00d3fb-42dc-4c82-a1aa-c81f3b4939c0 tempest-TestMinimumBasicScenario-999348880 None] Lock "cinder-quobyte-7bc4522b-b9bd-423f-adaf-ed76a236f8e1" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:46:24 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cf1237-110a-4abb-bc67-a240a9f87a81]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:46:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bb00d3fb-42dc-4c82-a1aa-c81f3b4939c0 tempest-TestMinimumBasicScenario-999348880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7bc4522b-b9bd-423f-adaf-ed76a236f8e1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:24 devstack sudo[101673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7bc4522b-b9bd-423f-adaf-ed76a236f8e1 Sep 05 11:46:24 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:24 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bb00d3fb-42dc-4c82-a1aa-c81f3b4939c0 tempest-TestMinimumBasicScenario-999348880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7bc4522b-b9bd-423f-adaf-ed76a236f8e1" returned: 0 in 0.476s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bb00d3fb-42dc-4c82-a1aa-c81f3b4939c0 tempest-TestMinimumBasicScenario-999348880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7bc4522b-b9bd-423f-adaf-ed76a236f8e1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:24 devstack sudo[101678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7bc4522b-b9bd-423f-adaf-ed76a236f8e1 Sep 05 11:46:24 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:25 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bb00d3fb-42dc-4c82-a1aa-c81f3b4939c0 tempest-TestMinimumBasicScenario-999348880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7bc4522b-b9bd-423f-adaf-ed76a236f8e1" returned: 0 in 0.259s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bb00d3fb-42dc-4c82-a1aa-c81f3b4939c0 tempest-TestMinimumBasicScenario-999348880 None] Lock "cinder-quobyte-7bc4522b-b9bd-423f-adaf-ed76a236f8e1" released by "delete_volume" :: held 0.795s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:46:25 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-bb00d3fb-42dc-4c82-a1aa-c81f3b4939c0 tempest-TestMinimumBasicScenario-999348880 None] Created reservations ['2d2228fc-a47f-4ce5-a3b2-58a3fce40eaa', '4b76886f-8060-49fd-b6ab-924bd5f0bb61', '5d455866-f2ac-4d4f-8d2b-65aabcdd7e93', '2a9f1b7b-76ad-4099-a637-03ba3da053a4'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:46:25 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e0ca641d-19af-4023-a5b6-c24ba211be4c tempest-VolumesTransfersTest-1358376078 None] Transfer volume completed successfully. Sep 05 11:46:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bb00d3fb-42dc-4c82-a1aa-c81f3b4939c0 tempest-TestMinimumBasicScenario-999348880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:46:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bb00d3fb-42dc-4c82-a1aa-c81f3b4939c0 tempest-TestMinimumBasicScenario-999348880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:46:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bb00d3fb-42dc-4c82-a1aa-c81f3b4939c0 tempest-TestMinimumBasicScenario-999348880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:46:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bb00d3fb-42dc-4c82-a1aa-c81f3b4939c0 tempest-TestMinimumBasicScenario-999348880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:46:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bb00d3fb-42dc-4c82-a1aa-c81f3b4939c0 tempest-TestMinimumBasicScenario-999348880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:46:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bb00d3fb-42dc-4c82-a1aa-c81f3b4939c0 tempest-TestMinimumBasicScenario-999348880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:25 devstack sudo[101681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:46:25 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:25 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bb00d3fb-42dc-4c82-a1aa-c81f3b4939c0 tempest-TestMinimumBasicScenario-999348880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.356s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:25 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-bb00d3fb-42dc-4c82-a1aa-c81f3b4939c0 tempest-TestMinimumBasicScenario-999348880 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:46:25 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-bb00d3fb-42dc-4c82-a1aa-c81f3b4939c0 tempest-TestMinimumBasicScenario-999348880 None] Deleted volume successfully. Sep 05 11:46:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bb00d3fb-42dc-4c82-a1aa-c81f3b4939c0 tempest-TestMinimumBasicScenario-999348880 None] Lock "cinder-7bc4522b-b9bd-423f-adaf-ed76a236f8e1-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:46:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-28a1ff26-fcb4-4b7b-b6e8-28d1bfb2f7b2 tempest-VolumesTransfersTest-703200165 None] Acquiring lock "cinder-eb711c63-5e99-440a-bf4d-4b1ceba9b6d6-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:46:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-28a1ff26-fcb4-4b7b-b6e8-28d1bfb2f7b2 tempest-VolumesTransfersTest-703200165 None] Lock "cinder-eb711c63-5e99-440a-bf4d-4b1ceba9b6d6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:46:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-28a1ff26-fcb4-4b7b-b6e8-28d1bfb2f7b2 tempest-VolumesTransfersTest-703200165 None] Acquiring lock "cinder-quobyte-eb711c63-5e99-440a-bf4d-4b1ceba9b6d6" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:46:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-28a1ff26-fcb4-4b7b-b6e8-28d1bfb2f7b2 tempest-VolumesTransfersTest-703200165 None] Lock "cinder-quobyte-eb711c63-5e99-440a-bf4d-4b1ceba9b6d6" acquired by "delete_volume" :: waited 0.033s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:46:26 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff6185c-eefc-4bc9-aaf6-31ec173a228f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:46:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-28a1ff26-fcb4-4b7b-b6e8-28d1bfb2f7b2 tempest-VolumesTransfersTest-703200165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eb711c63-5e99-440a-bf4d-4b1ceba9b6d6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:26 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eb711c63-5e99-440a-bf4d-4b1ceba9b6d6 Sep 05 11:46:26 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:26 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-28a1ff26-fcb4-4b7b-b6e8-28d1bfb2f7b2 tempest-VolumesTransfersTest-703200165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eb711c63-5e99-440a-bf4d-4b1ceba9b6d6" returned: 0 in 0.410s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-28a1ff26-fcb4-4b7b-b6e8-28d1bfb2f7b2 tempest-VolumesTransfersTest-703200165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eb711c63-5e99-440a-bf4d-4b1ceba9b6d6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:26 devstack sudo[101708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eb711c63-5e99-440a-bf4d-4b1ceba9b6d6 Sep 05 11:46:26 devstack sudo[101708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:27 devstack sudo[101708]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-28a1ff26-fcb4-4b7b-b6e8-28d1bfb2f7b2 tempest-VolumesTransfersTest-703200165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eb711c63-5e99-440a-bf4d-4b1ceba9b6d6" returned: 0 in 0.335s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-28a1ff26-fcb4-4b7b-b6e8-28d1bfb2f7b2 tempest-VolumesTransfersTest-703200165 None] Lock "cinder-quobyte-eb711c63-5e99-440a-bf4d-4b1ceba9b6d6" released by "delete_volume" :: held 0.819s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:46:27 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-28a1ff26-fcb4-4b7b-b6e8-28d1bfb2f7b2 tempest-VolumesTransfersTest-703200165 None] Created reservations ['f8c82b6a-e0fd-4363-be32-e22d40366df2', '142339f4-2f6a-438f-98fd-db511e805655', '44bcee5d-48d8-4c52-b9f9-749cea87acea', '17baaf39-6cb1-4a67-860c-dc69812c89ab'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:46:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-28a1ff26-fcb4-4b7b-b6e8-28d1bfb2f7b2 tempest-VolumesTransfersTest-703200165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:46:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-28a1ff26-fcb4-4b7b-b6e8-28d1bfb2f7b2 tempest-VolumesTransfersTest-703200165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:46:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-28a1ff26-fcb4-4b7b-b6e8-28d1bfb2f7b2 tempest-VolumesTransfersTest-703200165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:46:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-28a1ff26-fcb4-4b7b-b6e8-28d1bfb2f7b2 tempest-VolumesTransfersTest-703200165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:46:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-28a1ff26-fcb4-4b7b-b6e8-28d1bfb2f7b2 tempest-VolumesTransfersTest-703200165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:46:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-28a1ff26-fcb4-4b7b-b6e8-28d1bfb2f7b2 tempest-VolumesTransfersTest-703200165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:27 devstack sudo[101712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:46:27 devstack sudo[101712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:27 devstack sudo[101712]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-28a1ff26-fcb4-4b7b-b6e8-28d1bfb2f7b2 tempest-VolumesTransfersTest-703200165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.431s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:27 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-28a1ff26-fcb4-4b7b-b6e8-28d1bfb2f7b2 tempest-VolumesTransfersTest-703200165 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:46:27 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-28a1ff26-fcb4-4b7b-b6e8-28d1bfb2f7b2 tempest-VolumesTransfersTest-703200165 None] Deleted volume successfully. Sep 05 11:46:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-28a1ff26-fcb4-4b7b-b6e8-28d1bfb2f7b2 tempest-VolumesTransfersTest-703200165 None] Lock "cinder-eb711c63-5e99-440a-bf4d-4b1ceba9b6d6-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:46:28 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:46:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] Flow 'volume_create_manager' (614f26e9-54cc-4fc5-a381-91990be3335f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:46:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b36b1beb-4e61-408a-975f-fdf92e52ec99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b36b1beb-4e61-408a-975f-fdf92e52ec99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-364524344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80b43d8b-02a0-40ef-ab38-51999f40358a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff67b3c58b04e03ae77fa35a220e0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:46:28Z,use_quota=True,user_id='5cca7febc86d4f489ec1cb6919539686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6032b235-0198-45e3-87a7-4fc15315800f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6032b235-0198-45e3-87a7-4fc15315800f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f015d0b8-3006-42f5-b412-2b242784d2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f015d0b8-3006-42f5-b412-2b242784d2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80b43d8b-02a0-40ef-ab38-51999f40358a', 'volume_name': 'volume-80b43d8b-02a0-40ef-ab38-51999f40358a', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95e40223-55a1-4d20-ad8f-2bcf41234d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95e40223-55a1-4d20-ad8f-2bcf41234d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17c40293-69f0-4fcb-ac8a-ae9a9909621f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:28 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] Volume 80b43d8b-02a0-40ef-ab38-51999f40358a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80b43d8b-02a0-40ef-ab38-51999f40358a', 'volume_size': 1} Sep 05 11:46:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:46:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:46:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-364524344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80b43d8b-02a0-40ef-ab38-51999f40358a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff67b3c58b04e03ae77fa35a220e0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:46:28Z,use_quota=True,user_id='5cca7febc86d4f489ec1cb6919539686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:46:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] Creating volume 80b43d8b-02a0-40ef-ab38-51999f40358a {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:46:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:46:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:46:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:46:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:46:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:46:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:46:28 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:46:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-80b43d8b-02a0-40ef-ab38-51999f40358a 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:28 devstack sudo[101715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-80b43d8b-02a0-40ef-ab38-51999f40358a 1073741824 Sep 05 11:46:28 devstack sudo[101715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:28 devstack sudo[101715]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-80b43d8b-02a0-40ef-ab38-51999f40358a 1073741824" returned: 0 in 0.572s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-80b43d8b-02a0-40ef-ab38-51999f40358a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:28 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-80b43d8b-02a0-40ef-ab38-51999f40358a Sep 05 11:46:28 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:29 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-80b43d8b-02a0-40ef-ab38-51999f40358a" returned: 0 in 0.288s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:46:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:46:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17c40293-69f0-4fcb-ac8a-ae9a9909621f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80b43d8b-02a0-40ef-ab38-51999f40358a', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fbad65b-a207-478e-97fc-0898c4338cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:29 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] Volume volume-80b43d8b-02a0-40ef-ab38-51999f40358a (80b43d8b-02a0-40ef-ab38-51999f40358a): created successfully Sep 05 11:46:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fbad65b-a207-478e-97fc-0898c4338cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] Flow 'volume_create_manager' (614f26e9-54cc-4fc5-a381-91990be3335f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:46:29 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ce95354f-23ed-491e-aecd-c07d399af092 tempest-VolumesTransfersTest-743137284 None] Created volume successfully. Sep 05 11:46:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-12e89222-15d6-4c2e-94d7-d946a23aaa5b tempest-VolumesTransfersTest-703200165 None] Acquiring lock "cinder-80b43d8b-02a0-40ef-ab38-51999f40358a-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:46:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-12e89222-15d6-4c2e-94d7-d946a23aaa5b tempest-VolumesTransfersTest-703200165 None] Lock "cinder-80b43d8b-02a0-40ef-ab38-51999f40358a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:46:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-12e89222-15d6-4c2e-94d7-d946a23aaa5b tempest-VolumesTransfersTest-703200165 None] Acquiring lock "cinder-quobyte-80b43d8b-02a0-40ef-ab38-51999f40358a" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:46:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-12e89222-15d6-4c2e-94d7-d946a23aaa5b tempest-VolumesTransfersTest-703200165 None] Lock "cinder-quobyte-80b43d8b-02a0-40ef-ab38-51999f40358a" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:46:30 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e975db-400c-4b9d-ab24-c957827cf15e]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:46:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12e89222-15d6-4c2e-94d7-d946a23aaa5b tempest-VolumesTransfersTest-703200165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-80b43d8b-02a0-40ef-ab38-51999f40358a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:30 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-80b43d8b-02a0-40ef-ab38-51999f40358a Sep 05 11:46:30 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:31 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12e89222-15d6-4c2e-94d7-d946a23aaa5b tempest-VolumesTransfersTest-703200165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-80b43d8b-02a0-40ef-ab38-51999f40358a" returned: 0 in 0.410s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12e89222-15d6-4c2e-94d7-d946a23aaa5b tempest-VolumesTransfersTest-703200165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-80b43d8b-02a0-40ef-ab38-51999f40358a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:31 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-80b43d8b-02a0-40ef-ab38-51999f40358a Sep 05 11:46:31 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:31 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12e89222-15d6-4c2e-94d7-d946a23aaa5b tempest-VolumesTransfersTest-703200165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-80b43d8b-02a0-40ef-ab38-51999f40358a" returned: 0 in 0.307s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-12e89222-15d6-4c2e-94d7-d946a23aaa5b tempest-VolumesTransfersTest-703200165 None] Lock "cinder-quobyte-80b43d8b-02a0-40ef-ab38-51999f40358a" released by "delete_volume" :: held 0.767s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-12e89222-15d6-4c2e-94d7-d946a23aaa5b tempest-VolumesTransfersTest-703200165 None] Created reservations ['910d36e1-4bc6-4745-aed7-2cfd1ff60ca2', 'ffca16e9-a3b2-4393-8a54-dc07896a6973', '837dc3de-4f03-4096-9175-8404b583535b', 'a46965d7-c32b-4098-8964-fecd8fd6965e'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] Flow 'volume_create_manager' (5b8234a1-94b2-4fad-b487-f5bdc0d09a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bedb47b2-3675-405c-9e9b-156113cab3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12e89222-15d6-4c2e-94d7-d946a23aaa5b tempest-VolumesTransfersTest-703200165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12e89222-15d6-4c2e-94d7-d946a23aaa5b tempest-VolumesTransfersTest-703200165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-12e89222-15d6-4c2e-94d7-d946a23aaa5b tempest-VolumesTransfersTest-703200165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-12e89222-15d6-4c2e-94d7-d946a23aaa5b tempest-VolumesTransfersTest-703200165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12e89222-15d6-4c2e-94d7-d946a23aaa5b tempest-VolumesTransfersTest-703200165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12e89222-15d6-4c2e-94d7-d946a23aaa5b tempest-VolumesTransfersTest-703200165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bedb47b2-3675-405c-9e9b-156113cab3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-568749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3422dd10-83d9-4853-8b8d-512ac7459d11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e38a85453cd4e10abf03b8142c2b06e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:46:31Z,use_quota=True,user_id='be84ac46bfb446dea35ae37821d5796a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae98cbaf-d3d9-4cc6-9a22-9357ce56354c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae98cbaf-d3d9-4cc6-9a22-9357ce56354c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:31 devstack sudo[101734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:46:31 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89b58776-560a-4cab-93b2-f794080e1517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89b58776-560a-4cab-93b2-f794080e1517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3422dd10-83d9-4853-8b8d-512ac7459d11', 'volume_name': 'volume-3422dd10-83d9-4853-8b8d-512ac7459d11', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a4d68e6-6ac0-48e1-b247-8ce15d4fc861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a4d68e6-6ac0-48e1-b247-8ce15d4fc861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ae07ee-998c-43c9-b4e5-4e3717035889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:31 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] Volume 3422dd10-83d9-4853-8b8d-512ac7459d11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3422dd10-83d9-4853-8b8d-512ac7459d11', 'volume_size': 1} Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-568749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3422dd10-83d9-4853-8b8d-512ac7459d11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e38a85453cd4e10abf03b8142c2b06e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:46:31Z,use_quota=True,user_id='be84ac46bfb446dea35ae37821d5796a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] Creating volume 3422dd10-83d9-4853-8b8d-512ac7459d11 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:46:31 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:31 devstack sudo[101736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11 1073741824 Sep 05 11:46:31 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:31 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12e89222-15d6-4c2e-94d7-d946a23aaa5b tempest-VolumesTransfersTest-703200165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.292s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-12e89222-15d6-4c2e-94d7-d946a23aaa5b tempest-VolumesTransfersTest-703200165 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:46:31 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-12e89222-15d6-4c2e-94d7-d946a23aaa5b tempest-VolumesTransfersTest-703200165 None] Deleted volume successfully. Sep 05 11:46:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-12e89222-15d6-4c2e-94d7-d946a23aaa5b tempest-VolumesTransfersTest-703200165 None] Lock "cinder-80b43d8b-02a0-40ef-ab38-51999f40358a-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:46:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:46:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:46:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:46:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:46:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:46:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:46:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:32 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:46:32 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:32 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11 1073741824" returned: 0 in 0.705s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:32 devstack sudo[101780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11 Sep 05 11:46:32 devstack sudo[101780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:32 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.600s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:32 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:46:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:46:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread count: 28 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 11:46:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread info: [<_MainThread(MainThread, started 131707869511808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 11:46:32 devstack sudo[101780]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11" returned: 0 in 0.460s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:46:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:46:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ae07ee-998c-43c9-b4e5-4e3717035889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3422dd10-83d9-4853-8b8d-512ac7459d11', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (241d5953-53aa-4d0a-b363-7324024e3c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:33 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] Volume volume-3422dd10-83d9-4853-8b8d-512ac7459d11 (3422dd10-83d9-4853-8b8d-512ac7459d11): created successfully Sep 05 11:46:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (241d5953-53aa-4d0a-b363-7324024e3c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] Flow 'volume_create_manager' (5b8234a1-94b2-4fad-b487-f5bdc0d09a09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:46:33 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b38a711b-be56-4d6d-8dac-19114c78219f tempest-TestStampPattern-1601760735 None] Created volume successfully. Sep 05 11:46:42 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=37,cinder:UPDATE=46,cinder:INSERT=16,cinder:DELETE=4 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:46:43 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=39,cinder:UPDATE=55,cinder:INSERT=9,cinder:DELETE=5 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] Flow 'volume_create_manager' (b7438671-bc6f-4bb4-9f9c-dd80be068de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba85d71-c36e-43b7-8cb6-0e7a50286fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] Flow 'volume_create_manager' (350a055d-bce0-4e38-bbab-3b2c2e8b7880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a55599-ab00-4661-9b22-7c40b39cb5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba85d71-c36e-43b7-8cb6-0e7a50286fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=946919cf-0a8c-409d-8735-6cf131c86c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd270cdaa5241bb9958b5a8e2b1c7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:46:45Z,use_quota=True,user_id='b26c305a012a4ef19307d51c10aabf7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb7ff937-ed3a-403f-bb5b-3d3b2bfd184d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb7ff937-ed3a-403f-bb5b-3d3b2bfd184d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faa5fa46-ad0a-4019-ad4e-de5f7e88176b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faa5fa46-ad0a-4019-ad4e-de5f7e88176b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '946919cf-0a8c-409d-8735-6cf131c86c0f', 'volume_name': 'volume-946919cf-0a8c-409d-8735-6cf131c86c0f', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cd09b01-4950-428d-a33d-7c2bd709743a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cd09b01-4950-428d-a33d-7c2bd709743a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (753a93d8-9193-4c06-94c1-d6ce559b3cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:45 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] Volume 946919cf-0a8c-409d-8735-6cf131c86c0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-946919cf-0a8c-409d-8735-6cf131c86c0f', 'volume_size': 1} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=946919cf-0a8c-409d-8735-6cf131c86c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd270cdaa5241bb9958b5a8e2b1c7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:46:45Z,use_quota=True,user_id='b26c305a012a4ef19307d51c10aabf7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] Creating volume 946919cf-0a8c-409d-8735-6cf131c86c0f {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:46:45 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-946919cf-0a8c-409d-8735-6cf131c86c0f 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a55599-ab00-4661-9b22-7c40b39cb5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2026135361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63eb74f1-c777-44e3-86c4-37f4e8bd3094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='726b5256c73b483e88777915b075cc08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:46:45Z,use_quota=True,user_id='98f1ecb06d8a490f941b429ad2cb8910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:45 devstack sudo[101884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-946919cf-0a8c-409d-8735-6cf131c86c0f 1073741824 Sep 05 11:46:45 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0009bcc7-b931-4758-898a-0898b02074e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0009bcc7-b931-4758-898a-0898b02074e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c508302c-9d32-445d-a686-6e5ed1952cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c508302c-9d32-445d-a686-6e5ed1952cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63eb74f1-c777-44e3-86c4-37f4e8bd3094', 'volume_name': 'volume-63eb74f1-c777-44e3-86c4-37f4e8bd3094', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af348604-f885-46e9-8007-ee7fdb46597a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af348604-f885-46e9-8007-ee7fdb46597a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db6733a-4825-4a1b-8f1f-ebb1253d583b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:45 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] Volume 63eb74f1-c777-44e3-86c4-37f4e8bd3094: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63eb74f1-c777-44e3-86c4-37f4e8bd3094', 'volume_size': 1} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:46:45 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-946919cf-0a8c-409d-8735-6cf131c86c0f 1073741824" returned: 0 in 0.556s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-946919cf-0a8c-409d-8735-6cf131c86c0f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:45 devstack sudo[101891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-946919cf-0a8c-409d-8735-6cf131c86c0f Sep 05 11:46:45 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:46 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-946919cf-0a8c-409d-8735-6cf131c86c0f" returned: 0 in 0.267s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:46:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:46:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.810s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:46:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2026135361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63eb74f1-c777-44e3-86c4-37f4e8bd3094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='726b5256c73b483e88777915b075cc08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:46:45Z,use_quota=True,user_id='98f1ecb06d8a490f941b429ad2cb8910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:46:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] Creating volume 63eb74f1-c777-44e3-86c4-37f4e8bd3094 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:46:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:46:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:46:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:46:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:46:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:46:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:46:46 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:46:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-63eb74f1-c777-44e3-86c4-37f4e8bd3094 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (753a93d8-9193-4c06-94c1-d6ce559b3cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-946919cf-0a8c-409d-8735-6cf131c86c0f', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (093e486c-2bb5-490b-89c8-791dc351b682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:46 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-63eb74f1-c777-44e3-86c4-37f4e8bd3094 1073741824 Sep 05 11:46:46 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:46 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] Volume volume-946919cf-0a8c-409d-8735-6cf131c86c0f (946919cf-0a8c-409d-8735-6cf131c86c0f): created successfully Sep 05 11:46:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (093e486c-2bb5-490b-89c8-791dc351b682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] Flow 'volume_create_manager' (b7438671-bc6f-4bb4-9f9c-dd80be068de2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:46:46 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a610821d-3d5b-4c3d-8bcf-5957641ad780 tempest-CinderUnicodeTest-835489873 None] Created volume successfully. Sep 05 11:46:46 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-63eb74f1-c777-44e3-86c4-37f4e8bd3094 1073741824" returned: 0 in 0.446s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-63eb74f1-c777-44e3-86c4-37f4e8bd3094 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:46 devstack sudo[101899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-63eb74f1-c777-44e3-86c4-37f4e8bd3094 Sep 05 11:46:46 devstack sudo[101899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:46 devstack sudo[101899]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-63eb74f1-c777-44e3-86c4-37f4e8bd3094" returned: 0 in 0.250s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:46:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:46:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db6733a-4825-4a1b-8f1f-ebb1253d583b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63eb74f1-c777-44e3-86c4-37f4e8bd3094', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8addb8f-fe9e-44ae-ae3d-0622d04738d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:46 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] Volume volume-63eb74f1-c777-44e3-86c4-37f4e8bd3094 (63eb74f1-c777-44e3-86c4-37f4e8bd3094): created successfully Sep 05 11:46:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8addb8f-fe9e-44ae-ae3d-0622d04738d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:46 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] Flow 'volume_create_manager' (350a055d-bce0-4e38-bbab-3b2c2e8b7880) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:46:46 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b5de251c-dcf5-4bc4-9cdc-b5b4181f7230 tempest-VolumesTransfersV355Test-356243430 None] Created volume successfully. Sep 05 11:46:47 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:46:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] Flow 'volume_create_manager' (f793a653-bca5-4d94-9bab-0d6459a5cdc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:46:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (510dd602-72e6-4dd4-a660-816b9b1dda2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (510dd602-72e6-4dd4-a660-816b9b1dda2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:46:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-650473454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6536f3e-4680-4625-b0bf-51ff67b0dd22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd270cdaa5241bb9958b5a8e2b1c7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:46:47Z,use_quota=True,user_id='b26c305a012a4ef19307d51c10aabf7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad3e356f-34ae-40dd-a4ca-e69cefffeabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad3e356f-34ae-40dd-a4ca-e69cefffeabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d90789a6-9f7c-4b8d-998a-f281be24da66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d90789a6-9f7c-4b8d-998a-f281be24da66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6536f3e-4680-4625-b0bf-51ff67b0dd22', 'volume_name': 'volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd951e3e-c0a4-4b66-88ab-c5fd5ac3c803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd951e3e-c0a4-4b66-88ab-c5fd5ac3c803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:47 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56faaebc-c4e3-4ac4-aca8-2dc6cf4da1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:47 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] Volume d6536f3e-4680-4625-b0bf-51ff67b0dd22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22', 'volume_size': 1} Sep 05 11:46:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:46:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:46:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:46:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-650473454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6536f3e-4680-4625-b0bf-51ff67b0dd22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd270cdaa5241bb9958b5a8e2b1c7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:46:47Z,use_quota=True,user_id='b26c305a012a4ef19307d51c10aabf7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:46:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] Creating volume d6536f3e-4680-4625-b0bf-51ff67b0dd22 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:46:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:46:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:46:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:46:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:46:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:46:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:46:47 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:46:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:47 devstack sudo[101902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22 1073741824 Sep 05 11:46:47 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:48 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22 1073741824" returned: 0 in 0.467s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:48 devstack sudo[101909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22 Sep 05 11:46:48 devstack sudo[101909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:48 devstack sudo[101909]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22" returned: 0 in 0.267s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:46:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:46:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56faaebc-c4e3-4ac4-aca8-2dc6cf4da1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e67c718-d92d-47ae-8f74-b1548beb0fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:48 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] Volume volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22 (d6536f3e-4680-4625-b0bf-51ff67b0dd22): created successfully Sep 05 11:46:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e67c718-d92d-47ae-8f74-b1548beb0fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] Flow 'volume_create_manager' (f793a653-bca5-4d94-9bab-0d6459a5cdc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:46:48 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-1b67d401-8b0c-4978-ada8-e06bd216efac tempest-CinderUnicodeTest-835489873 None] Created volume successfully. Sep 05 11:46:48 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-24f3a1cf-a5cb-4cc3-bea5-2263cc69d8c4 tempest-VolumesTransfersV355Test-1796631647 None] Transfer volume completed successfully. Sep 05 11:46:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7afcae22-5578-42ec-b6b1-aae40b4887e2 tempest-VolumesTransfersV355Test-174941653 None] Acquiring lock "cinder-63eb74f1-c777-44e3-86c4-37f4e8bd3094-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:46:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7afcae22-5578-42ec-b6b1-aae40b4887e2 tempest-VolumesTransfersV355Test-174941653 None] Lock "cinder-63eb74f1-c777-44e3-86c4-37f4e8bd3094-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:46:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7afcae22-5578-42ec-b6b1-aae40b4887e2 tempest-VolumesTransfersV355Test-174941653 None] Acquiring lock "cinder-quobyte-63eb74f1-c777-44e3-86c4-37f4e8bd3094" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:46:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7afcae22-5578-42ec-b6b1-aae40b4887e2 tempest-VolumesTransfersV355Test-174941653 None] Lock "cinder-quobyte-63eb74f1-c777-44e3-86c4-37f4e8bd3094" acquired by "delete_volume" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:46:49 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ae3114-e1e6-4082-b700-c1e74017809c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:46:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7afcae22-5578-42ec-b6b1-aae40b4887e2 tempest-VolumesTransfersV355Test-174941653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-63eb74f1-c777-44e3-86c4-37f4e8bd3094 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:49 devstack sudo[101912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-63eb74f1-c777-44e3-86c4-37f4e8bd3094 Sep 05 11:46:49 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:49 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7afcae22-5578-42ec-b6b1-aae40b4887e2 tempest-VolumesTransfersV355Test-174941653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-63eb74f1-c777-44e3-86c4-37f4e8bd3094" returned: 0 in 0.426s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7afcae22-5578-42ec-b6b1-aae40b4887e2 tempest-VolumesTransfersV355Test-174941653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-63eb74f1-c777-44e3-86c4-37f4e8bd3094 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:49 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-63eb74f1-c777-44e3-86c4-37f4e8bd3094 Sep 05 11:46:49 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5b05a913-88fd-437b-8658-446ab8cc8234 tempest-CinderUnicodeTest-835489873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:46:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5b05a913-88fd-437b-8658-446ab8cc8234 tempest-CinderUnicodeTest-835489873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:46:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-5b05a913-88fd-437b-8658-446ab8cc8234 tempest-CinderUnicodeTest-835489873 None] Creating offline snapshot c0617ae6-f162-4979-9fef-391aec6d08cc of volume d6536f3e-4680-4625-b0bf-51ff67b0dd22 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:46:49 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b24bb2-3b7e-4f6c-bd88-8de3df356de7]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:46:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5b05a913-88fd-437b-8658-446ab8cc8234 tempest-CinderUnicodeTest-835489873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:50 devstack sudo[101920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22 Sep 05 11:46:50 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:50 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7afcae22-5578-42ec-b6b1-aae40b4887e2 tempest-VolumesTransfersV355Test-174941653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-63eb74f1-c777-44e3-86c4-37f4e8bd3094" returned: 0 in 0.256s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7afcae22-5578-42ec-b6b1-aae40b4887e2 tempest-VolumesTransfersV355Test-174941653 None] Lock "cinder-quobyte-63eb74f1-c777-44e3-86c4-37f4e8bd3094" released by "delete_volume" :: held 0.735s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:46:50 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-7afcae22-5578-42ec-b6b1-aae40b4887e2 tempest-VolumesTransfersV355Test-174941653 None] Created reservations ['f97d6527-b3df-4fda-a61a-dc558f023bc0', 'f9563a5c-c9cc-4618-9726-a92f60d0570f', 'ee55fb71-2f03-4d1a-b73a-b0aa77b73b7c', '79992ae2-be34-4300-b156-7f84eb86e9b1'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:46:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7afcae22-5578-42ec-b6b1-aae40b4887e2 tempest-VolumesTransfersV355Test-174941653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:46:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7afcae22-5578-42ec-b6b1-aae40b4887e2 tempest-VolumesTransfersV355Test-174941653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:46:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7afcae22-5578-42ec-b6b1-aae40b4887e2 tempest-VolumesTransfersV355Test-174941653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:46:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7afcae22-5578-42ec-b6b1-aae40b4887e2 tempest-VolumesTransfersV355Test-174941653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:46:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7afcae22-5578-42ec-b6b1-aae40b4887e2 tempest-VolumesTransfersV355Test-174941653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:46:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7afcae22-5578-42ec-b6b1-aae40b4887e2 tempest-VolumesTransfersV355Test-174941653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:50 devstack sudo[101926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:46:50 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:50 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5b05a913-88fd-437b-8658-446ab8cc8234 tempest-CinderUnicodeTest-835489873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22" returned: 0 in 0.386s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5b05a913-88fd-437b-8658-446ab8cc8234 tempest-CinderUnicodeTest-835489873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22.c0617ae6-f162-4979-9fef-391aec6d08cc 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:50 devstack sudo[101928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22.c0617ae6-f162-4979-9fef-391aec6d08cc 1G Sep 05 11:46:50 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:50 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7afcae22-5578-42ec-b6b1-aae40b4887e2 tempest-VolumesTransfersV355Test-174941653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.306s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:50 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-7afcae22-5578-42ec-b6b1-aae40b4887e2 tempest-VolumesTransfersV355Test-174941653 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:46:50 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7afcae22-5578-42ec-b6b1-aae40b4887e2 tempest-VolumesTransfersV355Test-174941653 None] Deleted volume successfully. Sep 05 11:46:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7afcae22-5578-42ec-b6b1-aae40b4887e2 tempest-VolumesTransfersV355Test-174941653 None] Lock "cinder-63eb74f1-c777-44e3-86c4-37f4e8bd3094-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:46:50 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5b05a913-88fd-437b-8658-446ab8cc8234 tempest-CinderUnicodeTest-835489873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22.c0617ae6-f162-4979-9fef-391aec6d08cc 1G" returned: 0 in 0.481s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5b05a913-88fd-437b-8658-446ab8cc8234 tempest-CinderUnicodeTest-835489873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22.c0617ae6-f162-4979-9fef-391aec6d08cc {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:50 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22.c0617ae6-f162-4979-9fef-391aec6d08cc Sep 05 11:46:50 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:51 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:46:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] Flow 'volume_create_manager' (52f96e1a-2c8e-47c1-8166-149429ac1058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:46:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac954db0-2029-460c-b345-4d97c07991a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:51 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5b05a913-88fd-437b-8658-446ab8cc8234 tempest-CinderUnicodeTest-835489873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22.c0617ae6-f162-4979-9fef-391aec6d08cc" returned: 0 in 0.351s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:51 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-5b05a913-88fd-437b-8658-446ab8cc8234 tempest-CinderUnicodeTest-835489873 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22.c0617ae6-f162-4979-9fef-391aec6d08cc is being set with open permissions: ugo+rw Sep 05 11:46:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5b05a913-88fd-437b-8658-446ab8cc8234 tempest-CinderUnicodeTest-835489873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22.c0617ae6-f162-4979-9fef-391aec6d08cc {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac954db0-2029-460c-b345-4d97c07991a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1260771031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0cd81b0-6188-47e5-b956-0d6a5a620e6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='726b5256c73b483e88777915b075cc08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:46:51Z,use_quota=True,user_id='98f1ecb06d8a490f941b429ad2cb8910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:51 devstack sudo[101939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22.c0617ae6-f162-4979-9fef-391aec6d08cc Sep 05 11:46:51 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e912bf-1b4f-4d90-ba71-d79b17e5c9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e912bf-1b4f-4d90-ba71-d79b17e5c9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0517dc2c-e2f7-45f1-af83-85ba5b269bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0517dc2c-e2f7-45f1-af83-85ba5b269bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0cd81b0-6188-47e5-b956-0d6a5a620e6f', 'volume_name': 'volume-a0cd81b0-6188-47e5-b956-0d6a5a620e6f', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b07649c8-13e6-4bc3-9c0e-629b43acabc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b07649c8-13e6-4bc3-9c0e-629b43acabc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49fc9d44-0e8e-425f-abb0-0b53a2cb7ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:51 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] Volume a0cd81b0-6188-47e5-b956-0d6a5a620e6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0cd81b0-6188-47e5-b956-0d6a5a620e6f', 'volume_size': 1} Sep 05 11:46:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:46:51 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5b05a913-88fd-437b-8658-446ab8cc8234 tempest-CinderUnicodeTest-835489873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22.c0617ae6-f162-4979-9fef-391aec6d08cc" returned: 0 in 0.240s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5b05a913-88fd-437b-8658-446ab8cc8234 tempest-CinderUnicodeTest-835489873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:51 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22.info Sep 05 11:46:51 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:51 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5b05a913-88fd-437b-8658-446ab8cc8234 tempest-CinderUnicodeTest-835489873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22.info" returned: 0 in 0.251s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:51 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-5b05a913-88fd-437b-8658-446ab8cc8234 tempest-CinderUnicodeTest-835489873 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22.info is being set with open permissions: ugo+rw Sep 05 11:46:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5b05a913-88fd-437b-8658-446ab8cc8234 tempest-CinderUnicodeTest-835489873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:51 devstack sudo[101945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22.info Sep 05 11:46:51 devstack sudo[101945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:51 devstack sudo[101945]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5b05a913-88fd-437b-8658-446ab8cc8234 tempest-CinderUnicodeTest-835489873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22.info" returned: 0 in 0.244s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5b05a913-88fd-437b-8658-446ab8cc8234 tempest-CinderUnicodeTest-835489873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.044s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:46:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.729s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:46:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1260771031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0cd81b0-6188-47e5-b956-0d6a5a620e6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='726b5256c73b483e88777915b075cc08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:46:51Z,use_quota=True,user_id='98f1ecb06d8a490f941b429ad2cb8910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:46:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] Creating volume a0cd81b0-6188-47e5-b956-0d6a5a620e6f {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:46:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:46:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:46:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:46:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:46:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:46:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:46:51 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:46:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-a0cd81b0-6188-47e5-b956-0d6a5a620e6f 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:51 devstack sudo[101955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-a0cd81b0-6188-47e5-b956-0d6a5a620e6f 1073741824 Sep 05 11:46:51 devstack sudo[101955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:51 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-5b05a913-88fd-437b-8658-446ab8cc8234 tempest-CinderUnicodeTest-835489873 None] Create snapshot completed successfully Sep 05 11:46:52 devstack sudo[101955]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-a0cd81b0-6188-47e5-b956-0d6a5a620e6f 1073741824" returned: 0 in 0.444s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-a0cd81b0-6188-47e5-b956-0d6a5a620e6f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:52 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-a0cd81b0-6188-47e5-b956-0d6a5a620e6f Sep 05 11:46:52 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:52 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-a0cd81b0-6188-47e5-b956-0d6a5a620e6f" returned: 0 in 0.256s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:52 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:46:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:46:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49fc9d44-0e8e-425f-abb0-0b53a2cb7ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0cd81b0-6188-47e5-b956-0d6a5a620e6f', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df54f39d-387e-45ba-8862-0a867e8eccc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:46:52 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] Volume volume-a0cd81b0-6188-47e5-b956-0d6a5a620e6f (a0cd81b0-6188-47e5-b956-0d6a5a620e6f): created successfully Sep 05 11:46:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df54f39d-387e-45ba-8862-0a867e8eccc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:46:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] Flow 'volume_create_manager' (52f96e1a-2c8e-47c1-8166-149429ac1058) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:46:52 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-8d25ee4c-8abe-4658-8705-fd9ca2f8a787 tempest-VolumesTransfersV355Test-356243430 None] Created volume successfully. Sep 05 11:46:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-889999db-f0eb-4808-b2c9-6a9a459c1268 tempest-CinderUnicodeTest-835489873 None] Acquiring lock "cinder-c0617ae6-f162-4979-9fef-391aec6d08cc-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:46:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-889999db-f0eb-4808-b2c9-6a9a459c1268 tempest-CinderUnicodeTest-835489873 None] Lock "cinder-c0617ae6-f162-4979-9fef-391aec6d08cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:46:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-889999db-f0eb-4808-b2c9-6a9a459c1268 tempest-CinderUnicodeTest-835489873 None] Acquiring lock "cinder-quobyte-d6536f3e-4680-4625-b0bf-51ff67b0dd22" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:46:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-889999db-f0eb-4808-b2c9-6a9a459c1268 tempest-CinderUnicodeTest-835489873 None] Lock "cinder-quobyte-d6536f3e-4680-4625-b0bf-51ff67b0dd22" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:46:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-889999db-f0eb-4808-b2c9-6a9a459c1268 tempest-CinderUnicodeTest-835489873 None] Acquiring lock "cinder-quobyte-c0617ae6-f162-4979-9fef-391aec6d08cc" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:46:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-889999db-f0eb-4808-b2c9-6a9a459c1268 tempest-CinderUnicodeTest-835489873 None] Lock "cinder-quobyte-c0617ae6-f162-4979-9fef-391aec6d08cc" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:46:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-889999db-f0eb-4808-b2c9-6a9a459c1268 tempest-CinderUnicodeTest-835489873 None] Deleting offline snapshot c0617ae6-f162-4979-9fef-391aec6d08cc of volume d6536f3e-4680-4625-b0bf-51ff67b0dd22 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:46:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-889999db-f0eb-4808-b2c9-6a9a459c1268 tempest-CinderUnicodeTest-835489873 None] snapshot_file for this snap is: volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22.c0617ae6-f162-4979-9fef-391aec6d08cc {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:46:53 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[17837440-fdbf-4dac-a51b-2ac8d917be4a]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:46:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-889999db-f0eb-4808-b2c9-6a9a459c1268 tempest-CinderUnicodeTest-835489873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22.c0617ae6-f162-4979-9fef-391aec6d08cc {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:53 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22.c0617ae6-f162-4979-9fef-391aec6d08cc Sep 05 11:46:53 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9ae9d58e-ad7f-4251-8202-c0710818b61b tempest-VolumesTransfersV355Test-174941653 None] Acquiring lock "cinder-a0cd81b0-6188-47e5-b956-0d6a5a620e6f-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:46:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9ae9d58e-ad7f-4251-8202-c0710818b61b tempest-VolumesTransfersV355Test-174941653 None] Lock "cinder-a0cd81b0-6188-47e5-b956-0d6a5a620e6f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:46:53 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9ae9d58e-ad7f-4251-8202-c0710818b61b tempest-VolumesTransfersV355Test-174941653 None] Acquiring lock "cinder-quobyte-a0cd81b0-6188-47e5-b956-0d6a5a620e6f" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:46:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-889999db-f0eb-4808-b2c9-6a9a459c1268 tempest-CinderUnicodeTest-835489873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22.c0617ae6-f162-4979-9fef-391aec6d08cc" returned: 0 in 0.441s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-889999db-f0eb-4808-b2c9-6a9a459c1268 tempest-CinderUnicodeTest-835489873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:46:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9ae9d58e-ad7f-4251-8202-c0710818b61b tempest-VolumesTransfersV355Test-174941653 None] Lock "cinder-quobyte-a0cd81b0-6188-47e5-b956-0d6a5a620e6f" acquired by "delete_volume" :: waited 0.039s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:46:53 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d08de4-0618-44f0-9189-76045a3f08ac]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:46:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-889999db-f0eb-4808-b2c9-6a9a459c1268 tempest-CinderUnicodeTest-835489873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:53 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[da280bdf-3500-4850-947e-d05dca1f8374]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:46:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9ae9d58e-ad7f-4251-8202-c0710818b61b tempest-VolumesTransfersV355Test-174941653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-a0cd81b0-6188-47e5-b956-0d6a5a620e6f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:53 devstack sudo[101970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22 Sep 05 11:46:53 devstack sudo[101970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:53 devstack sudo[101971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-a0cd81b0-6188-47e5-b956-0d6a5a620e6f Sep 05 11:46:53 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:54 devstack sudo[101970]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-889999db-f0eb-4808-b2c9-6a9a459c1268 tempest-CinderUnicodeTest-835489873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22" returned: 0 in 0.406s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-889999db-f0eb-4808-b2c9-6a9a459c1268 tempest-CinderUnicodeTest-835489873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22.c0617ae6-f162-4979-9fef-391aec6d08cc {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:54 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9ae9d58e-ad7f-4251-8202-c0710818b61b tempest-VolumesTransfersV355Test-174941653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-a0cd81b0-6188-47e5-b956-0d6a5a620e6f" returned: 0 in 0.411s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9ae9d58e-ad7f-4251-8202-c0710818b61b tempest-VolumesTransfersV355Test-174941653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-a0cd81b0-6188-47e5-b956-0d6a5a620e6f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:54 devstack sudo[101999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22.c0617ae6-f162-4979-9fef-391aec6d08cc Sep 05 11:46:54 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:54 devstack sudo[102001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-a0cd81b0-6188-47e5-b956-0d6a5a620e6f Sep 05 11:46:54 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:54 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9ae9d58e-ad7f-4251-8202-c0710818b61b tempest-VolumesTransfersV355Test-174941653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-a0cd81b0-6188-47e5-b956-0d6a5a620e6f" returned: 0 in 0.266s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9ae9d58e-ad7f-4251-8202-c0710818b61b tempest-VolumesTransfersV355Test-174941653 None] Lock "cinder-quobyte-a0cd81b0-6188-47e5-b956-0d6a5a620e6f" released by "delete_volume" :: held 0.723s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:46:54 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:54 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-9ae9d58e-ad7f-4251-8202-c0710818b61b tempest-VolumesTransfersV355Test-174941653 None] Created reservations ['cb8737a1-18f6-49b5-a05d-735f43e96cb9', 'd4209163-756e-40ab-9a7f-9b8996654cdd', 'd7417304-c9b0-4faa-af34-3338eaf345d8', 'f4b697d1-d5fe-4049-8284-0444dae5d4e4'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:46:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-889999db-f0eb-4808-b2c9-6a9a459c1268 tempest-CinderUnicodeTest-835489873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22.c0617ae6-f162-4979-9fef-391aec6d08cc" returned: 0 in 0.357s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-889999db-f0eb-4808-b2c9-6a9a459c1268 tempest-CinderUnicodeTest-835489873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22.c0617ae6-f162-4979-9fef-391aec6d08cc {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:54 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22.c0617ae6-f162-4979-9fef-391aec6d08cc Sep 05 11:46:54 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9ae9d58e-ad7f-4251-8202-c0710818b61b tempest-VolumesTransfersV355Test-174941653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:46:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9ae9d58e-ad7f-4251-8202-c0710818b61b tempest-VolumesTransfersV355Test-174941653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:46:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9ae9d58e-ad7f-4251-8202-c0710818b61b tempest-VolumesTransfersV355Test-174941653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:46:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9ae9d58e-ad7f-4251-8202-c0710818b61b tempest-VolumesTransfersV355Test-174941653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:46:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9ae9d58e-ad7f-4251-8202-c0710818b61b tempest-VolumesTransfersV355Test-174941653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:46:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9ae9d58e-ad7f-4251-8202-c0710818b61b tempest-VolumesTransfersV355Test-174941653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:54 devstack sudo[102009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:46:54 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:54 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-889999db-f0eb-4808-b2c9-6a9a459c1268 tempest-CinderUnicodeTest-835489873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22.c0617ae6-f162-4979-9fef-391aec6d08cc" returned: 0 in 0.279s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-889999db-f0eb-4808-b2c9-6a9a459c1268 tempest-CinderUnicodeTest-835489873 None] Lock "cinder-quobyte-c0617ae6-f162-4979-9fef-391aec6d08cc" released by "_delete_snapshot" :: held 1.630s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:46:54 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9ae9d58e-ad7f-4251-8202-c0710818b61b tempest-VolumesTransfersV355Test-174941653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.263s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:54 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-9ae9d58e-ad7f-4251-8202-c0710818b61b tempest-VolumesTransfersV355Test-174941653 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:46:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-889999db-f0eb-4808-b2c9-6a9a459c1268 tempest-CinderUnicodeTest-835489873 None] Lock "cinder-quobyte-d6536f3e-4680-4625-b0bf-51ff67b0dd22" released by "delete_snapshot" :: held 1.668s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:46:54 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-9ae9d58e-ad7f-4251-8202-c0710818b61b tempest-VolumesTransfersV355Test-174941653 None] Deleted volume successfully. Sep 05 11:46:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9ae9d58e-ad7f-4251-8202-c0710818b61b tempest-VolumesTransfersV355Test-174941653 None] Lock "cinder-a0cd81b0-6188-47e5-b956-0d6a5a620e6f-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:46:54 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-889999db-f0eb-4808-b2c9-6a9a459c1268 tempest-CinderUnicodeTest-835489873 None] Created reservations ['acf5a831-e80e-427f-8280-96eaf43e2a4b', 'e41601d6-5110-4b3d-806f-25840c6b7a3d', 'dfebfea6-f800-4f6d-86e7-f841452e40ae', '7deb95e1-0842-4291-8d68-04e383e7f682'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:46:54 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-889999db-f0eb-4808-b2c9-6a9a459c1268 tempest-CinderUnicodeTest-835489873 None] Delete snapshot completed successfully. Sep 05 11:46:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-889999db-f0eb-4808-b2c9-6a9a459c1268 tempest-CinderUnicodeTest-835489873 None] Lock "cinder-c0617ae6-f162-4979-9fef-391aec6d08cc-delete_snapshot" released by "delete_snapshot" :: held 1.829s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:46:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-037762d9-61ae-4ecf-80d7-b7a8818ca1d2 tempest-CinderUnicodeTest-835489873 None] Acquiring lock "cinder-d6536f3e-4680-4625-b0bf-51ff67b0dd22-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:46:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-037762d9-61ae-4ecf-80d7-b7a8818ca1d2 tempest-CinderUnicodeTest-835489873 None] Lock "cinder-d6536f3e-4680-4625-b0bf-51ff67b0dd22-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:46:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-037762d9-61ae-4ecf-80d7-b7a8818ca1d2 tempest-CinderUnicodeTest-835489873 None] Acquiring lock "cinder-quobyte-d6536f3e-4680-4625-b0bf-51ff67b0dd22" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:46:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-037762d9-61ae-4ecf-80d7-b7a8818ca1d2 tempest-CinderUnicodeTest-835489873 None] Lock "cinder-quobyte-d6536f3e-4680-4625-b0bf-51ff67b0dd22" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:46:55 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5870b564-9ce1-4dd9-982c-59505a774253]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:46:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-037762d9-61ae-4ecf-80d7-b7a8818ca1d2 tempest-CinderUnicodeTest-835489873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:55 devstack sudo[102013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22 Sep 05 11:46:55 devstack sudo[102013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:55 devstack sudo[102013]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-037762d9-61ae-4ecf-80d7-b7a8818ca1d2 tempest-CinderUnicodeTest-835489873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22" returned: 0 in 0.380s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-037762d9-61ae-4ecf-80d7-b7a8818ca1d2 tempest-CinderUnicodeTest-835489873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:55 devstack sudo[102018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22 Sep 05 11:46:55 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:55 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-037762d9-61ae-4ecf-80d7-b7a8818ca1d2 tempest-CinderUnicodeTest-835489873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d6536f3e-4680-4625-b0bf-51ff67b0dd22" returned: 0 in 0.237s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-037762d9-61ae-4ecf-80d7-b7a8818ca1d2 tempest-CinderUnicodeTest-835489873 None] Lock "cinder-quobyte-d6536f3e-4680-4625-b0bf-51ff67b0dd22" released by "delete_volume" :: held 0.680s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:46:56 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-037762d9-61ae-4ecf-80d7-b7a8818ca1d2 tempest-CinderUnicodeTest-835489873 None] Created reservations ['474d8163-4fcf-4a51-a751-083f7d6b5127', 'd6c5807c-4c0e-4093-96d3-a06f7e7060c6', '2cbeaaa5-e221-4337-b0bf-7f989ebca2d0', '02a7fca9-be3e-4b5e-9c20-35867e3f7da0'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:46:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-037762d9-61ae-4ecf-80d7-b7a8818ca1d2 tempest-CinderUnicodeTest-835489873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:46:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-037762d9-61ae-4ecf-80d7-b7a8818ca1d2 tempest-CinderUnicodeTest-835489873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:46:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-037762d9-61ae-4ecf-80d7-b7a8818ca1d2 tempest-CinderUnicodeTest-835489873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:46:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-037762d9-61ae-4ecf-80d7-b7a8818ca1d2 tempest-CinderUnicodeTest-835489873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:46:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-037762d9-61ae-4ecf-80d7-b7a8818ca1d2 tempest-CinderUnicodeTest-835489873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:46:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-037762d9-61ae-4ecf-80d7-b7a8818ca1d2 tempest-CinderUnicodeTest-835489873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:56 devstack sudo[102021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:46:56 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:56 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-037762d9-61ae-4ecf-80d7-b7a8818ca1d2 tempest-CinderUnicodeTest-835489873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.281s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:56 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-037762d9-61ae-4ecf-80d7-b7a8818ca1d2 tempest-CinderUnicodeTest-835489873 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:46:56 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-037762d9-61ae-4ecf-80d7-b7a8818ca1d2 tempest-CinderUnicodeTest-835489873 None] Deleted volume successfully. Sep 05 11:46:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-037762d9-61ae-4ecf-80d7-b7a8818ca1d2 tempest-CinderUnicodeTest-835489873 None] Lock "cinder-d6536f3e-4680-4625-b0bf-51ff67b0dd22-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:46:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-258ce4a1-5b24-4cac-8d0d-a3172882944e tempest-CinderUnicodeTest-835489873 None] Acquiring lock "cinder-946919cf-0a8c-409d-8735-6cf131c86c0f-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:46:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-258ce4a1-5b24-4cac-8d0d-a3172882944e tempest-CinderUnicodeTest-835489873 None] Lock "cinder-946919cf-0a8c-409d-8735-6cf131c86c0f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:46:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-258ce4a1-5b24-4cac-8d0d-a3172882944e tempest-CinderUnicodeTest-835489873 None] Acquiring lock "cinder-quobyte-946919cf-0a8c-409d-8735-6cf131c86c0f" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:46:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-258ce4a1-5b24-4cac-8d0d-a3172882944e tempest-CinderUnicodeTest-835489873 None] Lock "cinder-quobyte-946919cf-0a8c-409d-8735-6cf131c86c0f" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:46:56 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbb0f8a-770a-4682-8ddb-6cbf00269272]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:46:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-258ce4a1-5b24-4cac-8d0d-a3172882944e tempest-CinderUnicodeTest-835489873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-946919cf-0a8c-409d-8735-6cf131c86c0f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:56 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-946919cf-0a8c-409d-8735-6cf131c86c0f Sep 05 11:46:56 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:56 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-258ce4a1-5b24-4cac-8d0d-a3172882944e tempest-CinderUnicodeTest-835489873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-946919cf-0a8c-409d-8735-6cf131c86c0f" returned: 0 in 0.402s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-258ce4a1-5b24-4cac-8d0d-a3172882944e tempest-CinderUnicodeTest-835489873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-946919cf-0a8c-409d-8735-6cf131c86c0f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:56 devstack sudo[102030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-946919cf-0a8c-409d-8735-6cf131c86c0f Sep 05 11:46:56 devstack sudo[102030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:57 devstack sudo[102030]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-258ce4a1-5b24-4cac-8d0d-a3172882944e tempest-CinderUnicodeTest-835489873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-946919cf-0a8c-409d-8735-6cf131c86c0f" returned: 0 in 0.261s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-258ce4a1-5b24-4cac-8d0d-a3172882944e tempest-CinderUnicodeTest-835489873 None] Lock "cinder-quobyte-946919cf-0a8c-409d-8735-6cf131c86c0f" released by "delete_volume" :: held 0.705s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:46:57 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-258ce4a1-5b24-4cac-8d0d-a3172882944e tempest-CinderUnicodeTest-835489873 None] Created reservations ['be9f8c9b-b8a2-4335-bc16-4b678cb9c9bf', 'bc8dda20-6b86-4540-bfec-fb6d3f58ae8d', 'c867dc29-2890-4117-9655-02b39c4c095a', 'dcbed74a-3327-4dad-9066-cd4ad6780870'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:46:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-258ce4a1-5b24-4cac-8d0d-a3172882944e tempest-CinderUnicodeTest-835489873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:46:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-258ce4a1-5b24-4cac-8d0d-a3172882944e tempest-CinderUnicodeTest-835489873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:46:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-258ce4a1-5b24-4cac-8d0d-a3172882944e tempest-CinderUnicodeTest-835489873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:46:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-258ce4a1-5b24-4cac-8d0d-a3172882944e tempest-CinderUnicodeTest-835489873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:46:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-258ce4a1-5b24-4cac-8d0d-a3172882944e tempest-CinderUnicodeTest-835489873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:46:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-258ce4a1-5b24-4cac-8d0d-a3172882944e tempest-CinderUnicodeTest-835489873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:46:57 devstack sudo[102033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:46:57 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:46:57 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root Sep 05 11:46:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-258ce4a1-5b24-4cac-8d0d-a3172882944e tempest-CinderUnicodeTest-835489873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.280s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:46:57 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-258ce4a1-5b24-4cac-8d0d-a3172882944e tempest-CinderUnicodeTest-835489873 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:46:57 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-258ce4a1-5b24-4cac-8d0d-a3172882944e tempest-CinderUnicodeTest-835489873 None] Deleted volume successfully. Sep 05 11:46:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-258ce4a1-5b24-4cac-8d0d-a3172882944e tempest-CinderUnicodeTest-835489873 None] Lock "cinder-946919cf-0a8c-409d-8735-6cf131c86c0f-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:47:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-2ccd9f2d-8400-4064-a6ce-6f88ac7e7806 req-36c5190e-1b55-404c-8518-13fdfa495185 tempest-TestStampPattern-1601760735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:47:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-2ccd9f2d-8400-4064-a6ce-6f88ac7e7806 req-36c5190e-1b55-404c-8518-13fdfa495185 tempest-TestStampPattern-1601760735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:47:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-2ccd9f2d-8400-4064-a6ce-6f88ac7e7806 req-36c5190e-1b55-404c-8518-13fdfa495185 tempest-TestStampPattern-1601760735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:47:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-2ccd9f2d-8400-4064-a6ce-6f88ac7e7806 req-36c5190e-1b55-404c-8518-13fdfa495185 tempest-TestStampPattern-1601760735 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32', 'name': 'volume-3422dd10-83d9-4853-8b8d-512ac7459d11', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '184b6f1f-5192-4fd4-a246-fb8376b94562', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 11:47:06 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-2ccd9f2d-8400-4064-a6ce-6f88ac7e7806 req-36c5190e-1b55-404c-8518-13fdfa495185 tempest-TestStampPattern-1601760735 None] attachment_update completed successfully. Sep 05 11:47:10 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:47:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] Flow 'volume_create_manager' (ab0dbaa9-db23-4743-83ea-96f524773922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:47:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87127b6f-6da2-4054-b0a7-39fb6d683571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:47:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87127b6f-6da2-4054-b0a7-39fb6d683571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-735738751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e999f6d5-b710-4e46-9cf0-17c674671929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10ba21e58a874a75a577cc8a859687f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:47:10Z,use_quota=True,user_id='0af331212a13478d91481b4703fb0360',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:47:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be262234-f3b4-42d2-b758-891515d89002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:47:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be262234-f3b4-42d2-b758-891515d89002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:47:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a950ccf2-7776-4a6a-918a-80ad4a4c9d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:47:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a950ccf2-7776-4a6a-918a-80ad4a4c9d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e999f6d5-b710-4e46-9cf0-17c674671929', 'volume_name': 'volume-e999f6d5-b710-4e46-9cf0-17c674671929', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:47:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234e09b2-db3d-46dd-9d8b-b9df7407b634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:47:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234e09b2-db3d-46dd-9d8b-b9df7407b634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:47:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f0a6d5-d31d-43df-9657-57ba93a0105c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:47:10 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] Volume e999f6d5-b710-4e46-9cf0-17c674671929: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e999f6d5-b710-4e46-9cf0-17c674671929', 'volume_size': 1} Sep 05 11:47:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:47:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:47:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-735738751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e999f6d5-b710-4e46-9cf0-17c674671929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10ba21e58a874a75a577cc8a859687f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:47:10Z,use_quota=True,user_id='0af331212a13478d91481b4703fb0360',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:47:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] Creating volume e999f6d5-b710-4e46-9cf0-17c674671929 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:47:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:47:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:47:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:47:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:47:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:47:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:47:10 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:47:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:47:10 devstack sudo[102450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929 1073741824 Sep 05 11:47:10 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:47:10 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root Sep 05 11:47:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929 1073741824" returned: 0 in 0.453s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:47:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:47:10 devstack sudo[102465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929 Sep 05 11:47:10 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:47:11 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root Sep 05 11:47:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929" returned: 0 in 0.249s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:47:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:47:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:47:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f0a6d5-d31d-43df-9657-57ba93a0105c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e999f6d5-b710-4e46-9cf0-17c674671929', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:47:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f3ca225-e61e-4416-9ffc-3e207815b404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:47:11 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] Volume volume-e999f6d5-b710-4e46-9cf0-17c674671929 (e999f6d5-b710-4e46-9cf0-17c674671929): created successfully Sep 05 11:47:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f3ca225-e61e-4416-9ffc-3e207815b404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:47:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] Flow 'volume_create_manager' (ab0dbaa9-db23-4743-83ea-96f524773922) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:47:11 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-55a4f233-e4d3-4e46-b24b-8c8aa19a68af tempest-VolumesActionsTest-1413902119 None] Created volume successfully. Sep 05 11:47:11 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-4e5b08f6-33a3-4f04-bc46-a206a814e03e req-9c3ba010-c666-4685-bf08-c73f53dad420 tempest-TestStampPattern-1601760735 None] Terminate volume connection completed successfully. Sep 05 11:47:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-4e5b08f6-33a3-4f04-bc46-a206a814e03e req-9c3ba010-c666-4685-bf08-c73f53dad420 tempest-TestStampPattern-1601760735 None] Deleting attachment 184b6f1f-5192-4fd4-a246-fb8376b94562. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 11:47:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a3f70cf5-356f-4256-aa2e-ef4ad065021c tempest-TestStampPattern-1601760735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:47:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a3f70cf5-356f-4256-aa2e-ef4ad065021c tempest-TestStampPattern-1601760735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:47:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-a3f70cf5-356f-4256-aa2e-ef4ad065021c tempest-TestStampPattern-1601760735 None] Creating offline snapshot 5c39a8e4-d002-41f5-b467-f6f54f61e91f of volume 3422dd10-83d9-4853-8b8d-512ac7459d11 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:47:12 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[06200c3a-6049-45be-ae38-c6e83594a2bc]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:47:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a3f70cf5-356f-4256-aa2e-ef4ad065021c tempest-TestStampPattern-1601760735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:47:12 devstack sudo[102499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11 Sep 05 11:47:12 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:47:13 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root Sep 05 11:47:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a3f70cf5-356f-4256-aa2e-ef4ad065021c tempest-TestStampPattern-1601760735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11" returned: 0 in 0.401s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:47:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a3f70cf5-356f-4256-aa2e-ef4ad065021c tempest-TestStampPattern-1601760735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11.5c39a8e4-d002-41f5-b467-f6f54f61e91f 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:47:13 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11.5c39a8e4-d002-41f5-b467-f6f54f61e91f 1G Sep 05 11:47:13 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:47:13 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Sep 05 11:47:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a3f70cf5-356f-4256-aa2e-ef4ad065021c tempest-TestStampPattern-1601760735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11.5c39a8e4-d002-41f5-b467-f6f54f61e91f 1G" returned: 0 in 0.473s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:47:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a3f70cf5-356f-4256-aa2e-ef4ad065021c tempest-TestStampPattern-1601760735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3422dd10-83d9-4853-8b8d-512ac7459d11 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11.5c39a8e4-d002-41f5-b467-f6f54f61e91f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:47:13 devstack sudo[102514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3422dd10-83d9-4853-8b8d-512ac7459d11 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11.5c39a8e4-d002-41f5-b467-f6f54f61e91f Sep 05 11:47:13 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:47:14 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root Sep 05 11:47:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a3f70cf5-356f-4256-aa2e-ef4ad065021c tempest-TestStampPattern-1601760735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3422dd10-83d9-4853-8b8d-512ac7459d11 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11.5c39a8e4-d002-41f5-b467-f6f54f61e91f" returned: 0 in 0.369s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:47:14 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-a3f70cf5-356f-4256-aa2e-ef4ad065021c tempest-TestStampPattern-1601760735 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11.5c39a8e4-d002-41f5-b467-f6f54f61e91f is being set with open permissions: ugo+rw Sep 05 11:47:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a3f70cf5-356f-4256-aa2e-ef4ad065021c tempest-TestStampPattern-1601760735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11.5c39a8e4-d002-41f5-b467-f6f54f61e91f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:47:14 devstack sudo[102529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11.5c39a8e4-d002-41f5-b467-f6f54f61e91f Sep 05 11:47:14 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:47:14 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root Sep 05 11:47:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a3f70cf5-356f-4256-aa2e-ef4ad065021c tempest-TestStampPattern-1601760735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11.5c39a8e4-d002-41f5-b467-f6f54f61e91f" returned: 0 in 0.266s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:47:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a3f70cf5-356f-4256-aa2e-ef4ad065021c tempest-TestStampPattern-1601760735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:47:14 devstack sudo[102536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11.info Sep 05 11:47:14 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:47:14 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root Sep 05 11:47:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a3f70cf5-356f-4256-aa2e-ef4ad065021c tempest-TestStampPattern-1601760735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11.info" returned: 0 in 0.281s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:47:14 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-a3f70cf5-356f-4256-aa2e-ef4ad065021c tempest-TestStampPattern-1601760735 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11.info is being set with open permissions: ugo+rw Sep 05 11:47:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a3f70cf5-356f-4256-aa2e-ef4ad065021c tempest-TestStampPattern-1601760735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:47:14 devstack sudo[102539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11.info Sep 05 11:47:14 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:47:14 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root Sep 05 11:47:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a3f70cf5-356f-4256-aa2e-ef4ad065021c tempest-TestStampPattern-1601760735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11.info" returned: 0 in 0.253s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:47:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a3f70cf5-356f-4256-aa2e-ef4ad065021c tempest-TestStampPattern-1601760735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.140s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:47:14 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a3f70cf5-356f-4256-aa2e-ef4ad065021c tempest-TestStampPattern-1601760735 None] Create snapshot completed successfully Sep 05 11:47:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-91148645-0487-4f44-9157-37c5b030007c tempest-VolumesActionsTest-1413902119 None] Acquiring lock "cinder-e999f6d5-b710-4e46-9cf0-17c674671929" by "attach_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:47:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-91148645-0487-4f44-9157-37c5b030007c tempest-VolumesActionsTest-1413902119 None] Lock "cinder-e999f6d5-b710-4e46-9cf0-17c674671929" acquired by "attach_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:47:18 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-91148645-0487-4f44-9157-37c5b030007c tempest-VolumesActionsTest-1413902119 None] Attaching volume e999f6d5-b710-4e46-9cf0-17c674671929 to instance e2b36457-22d8-493f-85a0-d0b635b462b2 at mountpoint /dev/vdb on host None. Sep 05 11:47:18 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-91148645-0487-4f44-9157-37c5b030007c tempest-VolumesActionsTest-1413902119 None] Attach volume completed successfully. Sep 05 11:47:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-91148645-0487-4f44-9157-37c5b030007c tempest-VolumesActionsTest-1413902119 None] Lock "cinder-e999f6d5-b710-4e46-9cf0-17c674671929" released by "attach_volume" :: held 0.084s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:47:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-67945675-626a-4726-ab6d-19c75fac5043 tempest-VolumesActionsTest-1413902119 None] Acquiring lock "cinder-e999f6d5-b710-4e46-9cf0-17c674671929-detach_volume" by "detach_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:47:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-67945675-626a-4726-ab6d-19c75fac5043 tempest-VolumesActionsTest-1413902119 None] Lock "cinder-e999f6d5-b710-4e46-9cf0-17c674671929-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:47:18 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-67945675-626a-4726-ab6d-19c75fac5043 tempest-VolumesActionsTest-1413902119 None] Detaching volume e999f6d5-b710-4e46-9cf0-17c674671929 from instance e2b36457-22d8-493f-85a0-d0b635b462b2. Sep 05 11:47:19 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-67945675-626a-4726-ab6d-19c75fac5043 tempest-VolumesActionsTest-1413902119 None] Detach volume completed successfully. Sep 05 11:47:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-67945675-626a-4726-ab6d-19c75fac5043 tempest-VolumesActionsTest-1413902119 None] Lock "cinder-e999f6d5-b710-4e46-9cf0-17c674671929-detach_volume" released by "detach_volume" :: held 0.069s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Flow 'volume_create_manager' (d4937776-3528-46a8-85e6-ab718d555631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7615f2dc-16ec-41f9-9297-6e043e00d8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7615f2dc-16ec-41f9-9297-6e043e00d8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-507930886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43fe89a1-3055-407a-a16c-56dd11819ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e38a85453cd4e10abf03b8142c2b06e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5c39a8e4-d002-41f5-b467-f6f54f61e91f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:47:23Z,use_quota=True,user_id='be84ac46bfb446dea35ae37821d5796a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55907aaf-40a1-4df6-a43a-e0fca0a8be85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55907aaf-40a1-4df6-a43a-e0fca0a8be85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b78e4f-6871-45c7-9125-f8608c0b59ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b78e4f-6871-45c7-9125-f8608c0b59ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '43fe89a1-3055-407a-a16c-56dd11819ffa', 'volume_name': 'volume-43fe89a1-3055-407a-a16c-56dd11819ffa', 'volume_size': 1, 'snapshot_id': '5c39a8e4-d002-41f5-b467-f6f54f61e91f'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (110e6ce3-8e10-461e-b5ea-6294586b7e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (110e6ce3-8e10-461e-b5ea-6294586b7e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (395de2b6-3d49-49a6-a7ff-3882738a34aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:47:23 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Volume 43fe89a1-3055-407a-a16c-56dd11819ffa: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-43fe89a1-3055-407a-a16c-56dd11819ffa', 'volume_size': 1, 'snapshot_id': '5c39a8e4-d002-41f5-b467-f6f54f61e91f'} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Acquiring lock "cinder-quobyte-5c39a8e4-d002-41f5-b467-f6f54f61e91f-43fe89a1-3055-407a-a16c-56dd11819ffa" by "_create_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Lock "cinder-quobyte-5c39a8e4-d002-41f5-b467-f6f54f61e91f-43fe89a1-3055-407a-a16c-56dd11819ffa" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Creating volume 43fe89a1-3055-407a-a16c-56dd11819ffa from snapshot 5c39a8e4-d002-41f5-b467-f6f54f61e91f {{(pid=87517) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Acquiring lock "cinder-quobyte-43fe89a1-3055-407a-a16c-56dd11819ffa" by "_copy_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Lock "cinder-quobyte-43fe89a1-3055-407a-a16c-56dd11819ffa" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] snapshot: 5c39a8e4-d002-41f5-b467-f6f54f61e91f, volume: 43fe89a1-3055-407a-a16c-56dd11819ffa, {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44a8dcd-4ed9-47dc-ad0b-018c702d8541]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11.5c39a8e4-d002-41f5-b467-f6f54f61e91f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:47:23 devstack sudo[102672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11.5c39a8e4-d002-41f5-b467-f6f54f61e91f Sep 05 11:47:23 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:47:23 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11.5c39a8e4-d002-41f5-b467-f6f54f61e91f" returned: 0 in 0.409s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3422dd10-83d9-4853-8b8d-512ac7459d11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cef141-d5f5-4421-8c2d-ba1c898e7cfb]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:47:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:47:24 devstack sudo[102677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11 Sep 05 11:47:24 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:47:24 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root Sep 05 11:47:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11" returned: 0 in 0.557s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:47:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11 {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 11:47:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Creating direct copy from snapshot {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 11:47:24 devstack cinder-volume[87517]: DEBUG cinder.utils [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Path /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-43fe89a1-3055-407a-a16c-56dd11819ffa not found in is_blk_device check {{(pid=87517) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 11:47:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-43fe89a1-3055-407a-a16c-56dd11819ffa {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:47:24 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-43fe89a1-3055-407a-a16c-56dd11819ffa Sep 05 11:47:24 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:47:30 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Sep 05 11:47:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-43fe89a1-3055-407a-a16c-56dd11819ffa" returned: 0 in 6.357s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:47:30 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Image conversion details: src /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11, size 1024.00 MB, duration 6.36 sec, destination /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-43fe89a1-3055-407a-a16c-56dd11819ffa {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 11:47:30 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Converted 1024.00 MB image at 160.94 MB/s Sep 05 11:47:30 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-43fe89a1-3055-407a-a16c-56dd11819ffa is being set with open permissions: ugo+rw Sep 05 11:47:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-43fe89a1-3055-407a-a16c-56dd11819ffa {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:47:30 devstack sudo[102719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-43fe89a1-3055-407a-a16c-56dd11819ffa Sep 05 11:47:30 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:47:31 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root Sep 05 11:47:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-43fe89a1-3055-407a-a16c-56dd11819ffa" returned: 0 in 0.586s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:47:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Lock "cinder-quobyte-43fe89a1-3055-407a-a16c-56dd11819ffa" released by "_copy_volume_from_snapshot" :: held 8.037s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:47:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Lock "cinder-quobyte-5c39a8e4-d002-41f5-b467-f6f54f61e91f-43fe89a1-3055-407a-a16c-56dd11819ffa" released by "_create_volume_from_snapshot" :: held 8.193s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:47:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.216s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:47:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (395de2b6-3d49-49a6-a7ff-3882738a34aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43fe89a1-3055-407a-a16c-56dd11819ffa', 'volume_size': 1, 'snapshot_id': '5c39a8e4-d002-41f5-b467-f6f54f61e91f'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:47:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db8e6bc1-9366-4152-8696-9ee18ed9af86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:47:31 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Volume volume-43fe89a1-3055-407a-a16c-56dd11819ffa (43fe89a1-3055-407a-a16c-56dd11819ffa): created successfully Sep 05 11:47:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db8e6bc1-9366-4152-8696-9ee18ed9af86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:47:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Flow 'volume_create_manager' (d4937776-3528-46a8-85e6-ab718d555631) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:47:31 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2e24cb73-75bc-4f03-b51e-d38812b3a91c tempest-TestStampPattern-1601760735 None] Created volume successfully. Sep 05 11:47:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:47:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:47:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:47:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:47:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:47:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:47:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:47:32 devstack sudo[102798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:47:32 devstack sudo[102798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:47:32 devstack sudo[102798]: pam_unix(sudo:session): session closed for user root Sep 05 11:47:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.313s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:47:32 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:47:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:47:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread count: 28 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 11:47:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread info: [<_MainThread(MainThread, started 131707869511808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 11:47:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d6149041-46e4-4bc6-94f7-0e66f08f652a tempest-VolumesActionsTest-1413902119 None] Acquiring lock "cinder-e999f6d5-b710-4e46-9cf0-17c674671929" by "attach_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:47:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d6149041-46e4-4bc6-94f7-0e66f08f652a tempest-VolumesActionsTest-1413902119 None] Lock "cinder-e999f6d5-b710-4e46-9cf0-17c674671929" acquired by "attach_volume" :: waited 0.037s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:47:34 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d6149041-46e4-4bc6-94f7-0e66f08f652a tempest-VolumesActionsTest-1413902119 None] Attaching volume e999f6d5-b710-4e46-9cf0-17c674671929 to instance 44b24e0b-2449-45d2-86a4-842283ad6d80 at mountpoint /dev/vdb on host None. Sep 05 11:47:34 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d6149041-46e4-4bc6-94f7-0e66f08f652a tempest-VolumesActionsTest-1413902119 None] Attach volume completed successfully. Sep 05 11:47:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d6149041-46e4-4bc6-94f7-0e66f08f652a tempest-VolumesActionsTest-1413902119 None] Lock "cinder-e999f6d5-b710-4e46-9cf0-17c674671929" released by "attach_volume" :: held 0.199s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:47:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-54f814d4-5d5e-4969-bc3a-18e86adf1ad4 tempest-VolumesActionsTest-1413902119 None] Acquiring lock "cinder-e999f6d5-b710-4e46-9cf0-17c674671929-detach_volume" by "detach_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:47:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-54f814d4-5d5e-4969-bc3a-18e86adf1ad4 tempest-VolumesActionsTest-1413902119 None] Lock "cinder-e999f6d5-b710-4e46-9cf0-17c674671929-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:47:35 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-54f814d4-5d5e-4969-bc3a-18e86adf1ad4 tempest-VolumesActionsTest-1413902119 None] Detaching volume e999f6d5-b710-4e46-9cf0-17c674671929 from instance 44b24e0b-2449-45d2-86a4-842283ad6d80. Sep 05 11:47:35 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-54f814d4-5d5e-4969-bc3a-18e86adf1ad4 tempest-VolumesActionsTest-1413902119 None] Detach volume completed successfully. Sep 05 11:47:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-54f814d4-5d5e-4969-bc3a-18e86adf1ad4 tempest-VolumesActionsTest-1413902119 None] Lock "cinder-e999f6d5-b710-4e46-9cf0-17c674671929-detach_volume" released by "detach_volume" :: held 0.082s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:47:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-edc338cb-6a43-48d9-a37b-5ad7de99e27a tempest-VolumesActionsTest-1413902119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:47:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-edc338cb-6a43-48d9-a37b-5ad7de99e27a tempest-VolumesActionsTest-1413902119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:47:40 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[680eca19-d936-4909-a544-c4cc8ae6e63e]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:47:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-edc338cb-6a43-48d9-a37b-5ad7de99e27a tempest-VolumesActionsTest-1413902119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:47:40 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929 Sep 05 11:47:40 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:47:40 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Sep 05 11:47:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-edc338cb-6a43-48d9-a37b-5ad7de99e27a tempest-VolumesActionsTest-1413902119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929" returned: 0 in 0.424s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:47:40 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[817636f5-e45c-4747-b7e0-a1597d85252c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:47:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-edc338cb-6a43-48d9-a37b-5ad7de99e27a tempest-VolumesActionsTest-1413902119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:47:40 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929 Sep 05 11:47:40 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:47:41 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Sep 05 11:47:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-edc338cb-6a43-48d9-a37b-5ad7de99e27a tempest-VolumesActionsTest-1413902119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929" returned: 0 in 0.427s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:47:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-edc338cb-6a43-48d9-a37b-5ad7de99e27a tempest-VolumesActionsTest-1413902119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929 /opt/stack/data/cinder/conversion/e999f6d5-b710-4e46-9cf0-17c674671929.temp_image.5dc05cf1-fc70-40a8-9260-b06737d210e771190nza.img {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:47:41 devstack sudo[102949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929 /opt/stack/data/cinder/conversion/e999f6d5-b710-4e46-9cf0-17c674671929.temp_image.5dc05cf1-fc70-40a8-9260-b06737d210e771190nza.img Sep 05 11:47:41 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:47:45 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=60,cinder:UPDATE=66,cinder:INSERT=18,cinder:DELETE=7 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:47:46 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root Sep 05 11:47:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-edc338cb-6a43-48d9-a37b-5ad7de99e27a tempest-VolumesActionsTest-1413902119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929 /opt/stack/data/cinder/conversion/e999f6d5-b710-4e46-9cf0-17c674671929.temp_image.5dc05cf1-fc70-40a8-9260-b06737d210e771190nza.img" returned: 0 in 5.181s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:47:46 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3b586e-d3f2-4c6e-a1fc-d70156758403]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:47:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-edc338cb-6a43-48d9-a37b-5ad7de99e27a tempest-VolumesActionsTest-1413902119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:47:46 devstack sudo[102963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929 Sep 05 11:47:46 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:47:47 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root Sep 05 11:47:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-edc338cb-6a43-48d9-a37b-5ad7de99e27a tempest-VolumesActionsTest-1413902119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929" returned: 0 in 0.549s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:47:47 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-edc338cb-6a43-48d9-a37b-5ad7de99e27a tempest-VolumesActionsTest-1413902119 None] Image conversion details: src /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929, size 1024.00 MB, duration 5.18 sec, destination /opt/stack/data/cinder/conversion/e999f6d5-b710-4e46-9cf0-17c674671929.temp_image.5dc05cf1-fc70-40a8-9260-b06737d210e771190nza.img {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 11:47:47 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-edc338cb-6a43-48d9-a37b-5ad7de99e27a tempest-VolumesActionsTest-1413902119 None] Converted 1024.00 MB image at 197.53 MB/s Sep 05 11:47:47 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=77,cinder:UPDATE=67,cinder:INSERT=14,cinder:DELETE=5 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:47:47 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-edc338cb-6a43-48d9-a37b-5ad7de99e27a tempest-VolumesActionsTest-1413902119 None] 5dc05cf1-fc70-40a8-9260-b06737d210e7 was raw, no need to convert to raw {{(pid=87517) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 05 11:47:57 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=1 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:48:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-df373990-3a5c-4979-bdcb-7e289339b6f0 req-bb5da0bc-e9f7-48ff-88b9-aac9bf6dd38b tempest-TestStampPattern-1601760735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-edc338cb-6a43-48d9-a37b-5ad7de99e27a tempest-VolumesActionsTest-1413902119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.307s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-edc338cb-6a43-48d9-a37b-5ad7de99e27a tempest-VolumesActionsTest-1413902119 None] Uploaded volume to glance image-id: 5dc05cf1-fc70-40a8-9260-b06737d210e7. {{(pid=87517) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 05 11:48:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-df373990-3a5c-4979-bdcb-7e289339b6f0 req-bb5da0bc-e9f7-48ff-88b9-aac9bf6dd38b tempest-TestStampPattern-1601760735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.935s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [req-df373990-3a5c-4979-bdcb-7e289339b6f0 req-bb5da0bc-e9f7-48ff-88b9-aac9bf6dd38b tempest-TestStampPattern-1601760735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:05 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-edc338cb-6a43-48d9-a37b-5ad7de99e27a tempest-VolumesActionsTest-1413902119 None] Copy volume to image completed successfully. Sep 05 11:48:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-df373990-3a5c-4979-bdcb-7e289339b6f0 req-bb5da0bc-e9f7-48ff-88b9-aac9bf6dd38b tempest-TestStampPattern-1601760735 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32', 'name': 'volume-43fe89a1-3055-407a-a16c-56dd11819ffa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '45df9d60-4e22-442b-9588-7dc46510c154', 'enforce_multipath': True} {{(pid=87517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 11:48:05 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-df373990-3a5c-4979-bdcb-7e289339b6f0 req-bb5da0bc-e9f7-48ff-88b9-aac9bf6dd38b tempest-TestStampPattern-1601760735 None] attachment_update completed successfully. Sep 05 11:48:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d291e269-46f3-49ec-a14e-0f3d82d7f9a0 tempest-VolumesActionsTest-1413902119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d291e269-46f3-49ec-a14e-0f3d82d7f9a0 tempest-VolumesActionsTest-1413902119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:07 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9f8a0e-9704-4e27-83c5-e7663119b406]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:48:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d291e269-46f3-49ec-a14e-0f3d82d7f9a0 tempest-VolumesActionsTest-1413902119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:07 devstack sudo[103399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929 Sep 05 11:48:07 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:07 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d291e269-46f3-49ec-a14e-0f3d82d7f9a0 tempest-VolumesActionsTest-1413902119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929" returned: 0 in 0.416s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:07 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1833c5-2391-4026-bb49-3d5d5d9e3435]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:48:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d291e269-46f3-49ec-a14e-0f3d82d7f9a0 tempest-VolumesActionsTest-1413902119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:07 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929 Sep 05 11:48:07 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:07 devstack cinder-volume[87517]: INFO cinder.volume.manager [req-06b52bfa-cd62-46f8-9ddb-8b1edf88ac7a req-bba42b5c-0d92-444e-9f5c-5fc22782595f tempest-TestStampPattern-1601760735 None] Terminate volume connection completed successfully. Sep 05 11:48:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [req-06b52bfa-cd62-46f8-9ddb-8b1edf88ac7a req-bba42b5c-0d92-444e-9f5c-5fc22782595f tempest-TestStampPattern-1601760735 None] Deleting attachment 45df9d60-4e22-442b-9588-7dc46510c154. {{(pid=87517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 11:48:08 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d291e269-46f3-49ec-a14e-0f3d82d7f9a0 tempest-VolumesActionsTest-1413902119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929" returned: 0 in 0.416s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d291e269-46f3-49ec-a14e-0f3d82d7f9a0 tempest-VolumesActionsTest-1413902119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929 /opt/stack/data/cinder/conversion/e999f6d5-b710-4e46-9cf0-17c674671929.temp_image.6816fbe7-500b-4e33-938b-29486ce405cacp9v15oh.img {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:08 devstack sudo[103437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929 /opt/stack/data/cinder/conversion/e999f6d5-b710-4e46-9cf0-17c674671929.temp_image.6816fbe7-500b-4e33-938b-29486ce405cacp9v15oh.img Sep 05 11:48:08 devstack sudo[103437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:13 devstack sudo[103437]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d291e269-46f3-49ec-a14e-0f3d82d7f9a0 tempest-VolumesActionsTest-1413902119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929 /opt/stack/data/cinder/conversion/e999f6d5-b710-4e46-9cf0-17c674671929.temp_image.6816fbe7-500b-4e33-938b-29486ce405cacp9v15oh.img" returned: 0 in 4.957s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:13 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e70afd-ab1d-44cf-b4a6-954c0892de22]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:48:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d291e269-46f3-49ec-a14e-0f3d82d7f9a0 tempest-VolumesActionsTest-1413902119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:13 devstack sudo[103478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929 Sep 05 11:48:13 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:13 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d291e269-46f3-49ec-a14e-0f3d82d7f9a0 tempest-VolumesActionsTest-1413902119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929" returned: 0 in 0.618s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:13 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-d291e269-46f3-49ec-a14e-0f3d82d7f9a0 tempest-VolumesActionsTest-1413902119 None] Image conversion details: src /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929, size 1024.00 MB, duration 4.96 sec, destination /opt/stack/data/cinder/conversion/e999f6d5-b710-4e46-9cf0-17c674671929.temp_image.6816fbe7-500b-4e33-938b-29486ce405cacp9v15oh.img {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 11:48:13 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-d291e269-46f3-49ec-a14e-0f3d82d7f9a0 tempest-VolumesActionsTest-1413902119 None] Converted 1024.00 MB image at 206.51 MB/s Sep 05 11:48:13 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-d291e269-46f3-49ec-a14e-0f3d82d7f9a0 tempest-VolumesActionsTest-1413902119 None] 6816fbe7-500b-4e33-938b-29486ce405ca was raw, converting to qcow2 {{(pid=87517) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 05 11:48:13 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[934800bf-d895-4cb4-862a-cfb34e65cfd6]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:48:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d291e269-46f3-49ec-a14e-0f3d82d7f9a0 tempest-VolumesActionsTest-1413902119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e999f6d5-b710-4e46-9cf0-17c674671929.temp_image.6816fbe7-500b-4e33-938b-29486ce405cacp9v15oh.img {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:13 devstack sudo[103485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e999f6d5-b710-4e46-9cf0-17c674671929.temp_image.6816fbe7-500b-4e33-938b-29486ce405cacp9v15oh.img Sep 05 11:48:13 devstack sudo[103485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:14 devstack sudo[103485]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d291e269-46f3-49ec-a14e-0f3d82d7f9a0 tempest-VolumesActionsTest-1413902119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e999f6d5-b710-4e46-9cf0-17c674671929.temp_image.6816fbe7-500b-4e33-938b-29486ce405cacp9v15oh.img" returned: 0 in 0.324s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d291e269-46f3-49ec-a14e-0f3d82d7f9a0 tempest-VolumesActionsTest-1413902119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e999f6d5-b710-4e46-9cf0-17c674671929.temp_image.6816fbe7-500b-4e33-938b-29486ce405cacp9v15oh.img {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:14 devstack sudo[103489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e999f6d5-b710-4e46-9cf0-17c674671929.temp_image.6816fbe7-500b-4e33-938b-29486ce405cacp9v15oh.img Sep 05 11:48:14 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:14 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d291e269-46f3-49ec-a14e-0f3d82d7f9a0 tempest-VolumesActionsTest-1413902119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e999f6d5-b710-4e46-9cf0-17c674671929.temp_image.6816fbe7-500b-4e33-938b-29486ce405cacp9v15oh.img" returned: 1 in 0.324s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d291e269-46f3-49ec-a14e-0f3d82d7f9a0 tempest-VolumesActionsTest-1413902119 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e999f6d5-b710-4e46-9cf0-17c674671929.temp_image.6816fbe7-500b-4e33-938b-29486ce405cacp9v15oh.img' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 11:48:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d291e269-46f3-49ec-a14e-0f3d82d7f9a0 tempest-VolumesActionsTest-1413902119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e999f6d5-b710-4e46-9cf0-17c674671929.temp_image.6816fbe7-500b-4e33-938b-29486ce405cacp9v15oh.img /opt/stack/data/cinder/conversion/vol_upload_1y4xs5dy {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:14 devstack sudo[103494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e999f6d5-b710-4e46-9cf0-17c674671929.temp_image.6816fbe7-500b-4e33-938b-29486ce405cacp9v15oh.img /opt/stack/data/cinder/conversion/vol_upload_1y4xs5dy Sep 05 11:48:14 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b352d323-c9d3-427a-95b9-eb88364559f9 tempest-TestStampPattern-1601760735 None] Acquiring lock "cinder-43fe89a1-3055-407a-a16c-56dd11819ffa-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:48:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b352d323-c9d3-427a-95b9-eb88364559f9 tempest-TestStampPattern-1601760735 None] Lock "cinder-43fe89a1-3055-407a-a16c-56dd11819ffa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:48:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b352d323-c9d3-427a-95b9-eb88364559f9 tempest-TestStampPattern-1601760735 None] Acquiring lock "cinder-quobyte-43fe89a1-3055-407a-a16c-56dd11819ffa" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:48:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b352d323-c9d3-427a-95b9-eb88364559f9 tempest-TestStampPattern-1601760735 None] Lock "cinder-quobyte-43fe89a1-3055-407a-a16c-56dd11819ffa" acquired by "delete_volume" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:48:14 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd094434-326b-4a93-b8c3-a4b86ee5c8e7]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:48:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b352d323-c9d3-427a-95b9-eb88364559f9 tempest-TestStampPattern-1601760735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-43fe89a1-3055-407a-a16c-56dd11819ffa {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:14 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d291e269-46f3-49ec-a14e-0f3d82d7f9a0 tempest-VolumesActionsTest-1413902119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e999f6d5-b710-4e46-9cf0-17c674671929.temp_image.6816fbe7-500b-4e33-938b-29486ce405cacp9v15oh.img /opt/stack/data/cinder/conversion/vol_upload_1y4xs5dy" returned: 0 in 0.261s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:14 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-d291e269-46f3-49ec-a14e-0f3d82d7f9a0 tempest-VolumesActionsTest-1413902119 None] Image conversion details: src /opt/stack/data/cinder/conversion/e999f6d5-b710-4e46-9cf0-17c674671929.temp_image.6816fbe7-500b-4e33-938b-29486ce405cacp9v15oh.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_1y4xs5dy {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 11:48:14 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-d291e269-46f3-49ec-a14e-0f3d82d7f9a0 tempest-VolumesActionsTest-1413902119 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 05 11:48:14 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fba003-261f-4acc-938c-ce2239618e14]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:48:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d291e269-46f3-49ec-a14e-0f3d82d7f9a0 tempest-VolumesActionsTest-1413902119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_1y4xs5dy {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:14 devstack sudo[103499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-43fe89a1-3055-407a-a16c-56dd11819ffa Sep 05 11:48:14 devstack sudo[103499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:14 devstack sudo[103500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_1y4xs5dy Sep 05 11:48:14 devstack sudo[103500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:15 devstack sudo[103499]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:15 devstack sudo[103500]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b352d323-c9d3-427a-95b9-eb88364559f9 tempest-TestStampPattern-1601760735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-43fe89a1-3055-407a-a16c-56dd11819ffa" returned: 0 in 0.376s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b352d323-c9d3-427a-95b9-eb88364559f9 tempest-TestStampPattern-1601760735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-43fe89a1-3055-407a-a16c-56dd11819ffa {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d291e269-46f3-49ec-a14e-0f3d82d7f9a0 tempest-VolumesActionsTest-1413902119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_1y4xs5dy" returned: 0 in 0.346s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:15 devstack sudo[103509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-43fe89a1-3055-407a-a16c-56dd11819ffa Sep 05 11:48:15 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:15 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b352d323-c9d3-427a-95b9-eb88364559f9 tempest-TestStampPattern-1601760735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-43fe89a1-3055-407a-a16c-56dd11819ffa" returned: 0 in 0.259s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b352d323-c9d3-427a-95b9-eb88364559f9 tempest-TestStampPattern-1601760735 None] Lock "cinder-quobyte-43fe89a1-3055-407a-a16c-56dd11819ffa" released by "delete_volume" :: held 0.679s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:48:15 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-b352d323-c9d3-427a-95b9-eb88364559f9 tempest-TestStampPattern-1601760735 None] Created reservations ['82bf6873-74af-4ee7-baa0-6e262db25a3c', 'fc3c15cc-7ec4-4366-9977-527fde4fe1ac', 'db56ee82-60c9-4838-bdbd-05fd900d1a4d', '8a48950a-af1f-4f8b-a2dd-83fe7795907a'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:48:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b352d323-c9d3-427a-95b9-eb88364559f9 tempest-TestStampPattern-1601760735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b352d323-c9d3-427a-95b9-eb88364559f9 tempest-TestStampPattern-1601760735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b352d323-c9d3-427a-95b9-eb88364559f9 tempest-TestStampPattern-1601760735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:48:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b352d323-c9d3-427a-95b9-eb88364559f9 tempest-TestStampPattern-1601760735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:48:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b352d323-c9d3-427a-95b9-eb88364559f9 tempest-TestStampPattern-1601760735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b352d323-c9d3-427a-95b9-eb88364559f9 tempest-TestStampPattern-1601760735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:15 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:48:15 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:15 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b352d323-c9d3-427a-95b9-eb88364559f9 tempest-TestStampPattern-1601760735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.262s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:15 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-b352d323-c9d3-427a-95b9-eb88364559f9 tempest-TestStampPattern-1601760735 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:48:15 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b352d323-c9d3-427a-95b9-eb88364559f9 tempest-TestStampPattern-1601760735 None] Deleted volume successfully. Sep 05 11:48:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b352d323-c9d3-427a-95b9-eb88364559f9 tempest-TestStampPattern-1601760735 None] Lock "cinder-43fe89a1-3055-407a-a16c-56dd11819ffa-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:48:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fa48a677-dfaa-4c8f-84ca-ceac57a887cb tempest-TestStampPattern-1601760735 None] Acquiring lock "cinder-5c39a8e4-d002-41f5-b467-f6f54f61e91f-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:48:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fa48a677-dfaa-4c8f-84ca-ceac57a887cb tempest-TestStampPattern-1601760735 None] Lock "cinder-5c39a8e4-d002-41f5-b467-f6f54f61e91f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:48:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fa48a677-dfaa-4c8f-84ca-ceac57a887cb tempest-TestStampPattern-1601760735 None] Acquiring lock "cinder-quobyte-3422dd10-83d9-4853-8b8d-512ac7459d11" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:48:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fa48a677-dfaa-4c8f-84ca-ceac57a887cb tempest-TestStampPattern-1601760735 None] Lock "cinder-quobyte-3422dd10-83d9-4853-8b8d-512ac7459d11" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:48:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fa48a677-dfaa-4c8f-84ca-ceac57a887cb tempest-TestStampPattern-1601760735 None] Acquiring lock "cinder-quobyte-5c39a8e4-d002-41f5-b467-f6f54f61e91f" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:48:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fa48a677-dfaa-4c8f-84ca-ceac57a887cb tempest-TestStampPattern-1601760735 None] Lock "cinder-quobyte-5c39a8e4-d002-41f5-b467-f6f54f61e91f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:48:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-fa48a677-dfaa-4c8f-84ca-ceac57a887cb tempest-TestStampPattern-1601760735 None] Deleting offline snapshot 5c39a8e4-d002-41f5-b467-f6f54f61e91f of volume 3422dd10-83d9-4853-8b8d-512ac7459d11 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:48:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-fa48a677-dfaa-4c8f-84ca-ceac57a887cb tempest-TestStampPattern-1601760735 None] snapshot_file for this snap is: volume-3422dd10-83d9-4853-8b8d-512ac7459d11.5c39a8e4-d002-41f5-b467-f6f54f61e91f {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:48:16 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bf4117-9c0b-4767-bc91-be2b8f80be85]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:48:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fa48a677-dfaa-4c8f-84ca-ceac57a887cb tempest-TestStampPattern-1601760735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11.5c39a8e4-d002-41f5-b467-f6f54f61e91f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:16 devstack sudo[103515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11.5c39a8e4-d002-41f5-b467-f6f54f61e91f Sep 05 11:48:16 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d291e269-46f3-49ec-a14e-0f3d82d7f9a0 tempest-VolumesActionsTest-1413902119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.092s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d291e269-46f3-49ec-a14e-0f3d82d7f9a0 tempest-VolumesActionsTest-1413902119 None] Uploaded volume to glance image-id: 6816fbe7-500b-4e33-938b-29486ce405ca. {{(pid=87517) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 05 11:48:16 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d291e269-46f3-49ec-a14e-0f3d82d7f9a0 tempest-VolumesActionsTest-1413902119 None] Copy volume to image completed successfully. Sep 05 11:48:16 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fa48a677-dfaa-4c8f-84ca-ceac57a887cb tempest-TestStampPattern-1601760735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11.5c39a8e4-d002-41f5-b467-f6f54f61e91f" returned: 0 in 0.364s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-fa48a677-dfaa-4c8f-84ca-ceac57a887cb tempest-TestStampPattern-1601760735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3422dd10-83d9-4853-8b8d-512ac7459d11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:48:16 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[6044abbe-2752-4da2-95c6-20c6c2816c58]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:48:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fa48a677-dfaa-4c8f-84ca-ceac57a887cb tempest-TestStampPattern-1601760735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:16 devstack sudo[103521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11 Sep 05 11:48:16 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:17 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fa48a677-dfaa-4c8f-84ca-ceac57a887cb tempest-TestStampPattern-1601760735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11" returned: 0 in 0.516s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fa48a677-dfaa-4c8f-84ca-ceac57a887cb tempest-TestStampPattern-1601760735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11.5c39a8e4-d002-41f5-b467-f6f54f61e91f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:17 devstack sudo[103527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11.5c39a8e4-d002-41f5-b467-f6f54f61e91f Sep 05 11:48:17 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:17 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fa48a677-dfaa-4c8f-84ca-ceac57a887cb tempest-TestStampPattern-1601760735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11.5c39a8e4-d002-41f5-b467-f6f54f61e91f" returned: 0 in 0.339s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fa48a677-dfaa-4c8f-84ca-ceac57a887cb tempest-TestStampPattern-1601760735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11.5c39a8e4-d002-41f5-b467-f6f54f61e91f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:17 devstack sudo[103532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11.5c39a8e4-d002-41f5-b467-f6f54f61e91f Sep 05 11:48:17 devstack sudo[103532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:17 devstack sudo[103532]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fa48a677-dfaa-4c8f-84ca-ceac57a887cb tempest-TestStampPattern-1601760735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11.5c39a8e4-d002-41f5-b467-f6f54f61e91f" returned: 0 in 0.267s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-90be6a73-4740-47de-9005-cf8da22ee5bc tempest-VolumesActionsTest-1413902119 None] Acquiring lock "cinder-e999f6d5-b710-4e46-9cf0-17c674671929-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:48:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fa48a677-dfaa-4c8f-84ca-ceac57a887cb tempest-TestStampPattern-1601760735 None] Lock "cinder-quobyte-5c39a8e4-d002-41f5-b467-f6f54f61e91f" released by "_delete_snapshot" :: held 1.598s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:48:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fa48a677-dfaa-4c8f-84ca-ceac57a887cb tempest-TestStampPattern-1601760735 None] Lock "cinder-quobyte-3422dd10-83d9-4853-8b8d-512ac7459d11" released by "delete_snapshot" :: held 1.623s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:48:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-90be6a73-4740-47de-9005-cf8da22ee5bc tempest-VolumesActionsTest-1413902119 None] Lock "cinder-e999f6d5-b710-4e46-9cf0-17c674671929-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:48:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-90be6a73-4740-47de-9005-cf8da22ee5bc tempest-VolumesActionsTest-1413902119 None] Acquiring lock "cinder-quobyte-e999f6d5-b710-4e46-9cf0-17c674671929" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:48:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-90be6a73-4740-47de-9005-cf8da22ee5bc tempest-VolumesActionsTest-1413902119 None] Lock "cinder-quobyte-e999f6d5-b710-4e46-9cf0-17c674671929" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:48:17 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7972d35-d6ad-47cc-94b5-fde6ecc6a194]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:48:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-90be6a73-4740-47de-9005-cf8da22ee5bc tempest-VolumesActionsTest-1413902119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:17 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-fa48a677-dfaa-4c8f-84ca-ceac57a887cb tempest-TestStampPattern-1601760735 None] Created reservations ['a55fe42e-dcd3-4b0d-bc58-5d83f6ca0b60', 'f08d5117-6e62-4097-814d-616b5cdba446', 'ba2c344e-92d8-4038-b1c5-1f920983a993', '6adb3c59-6edf-4411-a22a-e2786874c1dd'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:48:17 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-fa48a677-dfaa-4c8f-84ca-ceac57a887cb tempest-TestStampPattern-1601760735 None] Delete snapshot completed successfully. Sep 05 11:48:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fa48a677-dfaa-4c8f-84ca-ceac57a887cb tempest-TestStampPattern-1601760735 None] Lock "cinder-5c39a8e4-d002-41f5-b467-f6f54f61e91f-delete_snapshot" released by "delete_snapshot" :: held 1.815s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:48:17 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929 Sep 05 11:48:17 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:18 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-90be6a73-4740-47de-9005-cf8da22ee5bc tempest-VolumesActionsTest-1413902119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929" returned: 0 in 0.364s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-90be6a73-4740-47de-9005-cf8da22ee5bc tempest-VolumesActionsTest-1413902119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:18 devstack sudo[103540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929 Sep 05 11:48:18 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:18 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-90be6a73-4740-47de-9005-cf8da22ee5bc tempest-VolumesActionsTest-1413902119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e999f6d5-b710-4e46-9cf0-17c674671929" returned: 0 in 0.254s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-90be6a73-4740-47de-9005-cf8da22ee5bc tempest-VolumesActionsTest-1413902119 None] Lock "cinder-quobyte-e999f6d5-b710-4e46-9cf0-17c674671929" released by "delete_volume" :: held 0.654s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:48:18 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-90be6a73-4740-47de-9005-cf8da22ee5bc tempest-VolumesActionsTest-1413902119 None] Created reservations ['97fb69fa-fa8f-407a-a392-1bb2eda4e9f3', '7e5b3373-0fd9-4c01-b82a-7da6cd64d08d', '614ffc82-98a7-49c5-917d-384e2d1f1372', '3924964d-e569-4daa-bdae-c9d66145cd80'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:48:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-90be6a73-4740-47de-9005-cf8da22ee5bc tempest-VolumesActionsTest-1413902119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-90be6a73-4740-47de-9005-cf8da22ee5bc tempest-VolumesActionsTest-1413902119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-90be6a73-4740-47de-9005-cf8da22ee5bc tempest-VolumesActionsTest-1413902119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:48:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-90be6a73-4740-47de-9005-cf8da22ee5bc tempest-VolumesActionsTest-1413902119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:48:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-90be6a73-4740-47de-9005-cf8da22ee5bc tempest-VolumesActionsTest-1413902119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-90be6a73-4740-47de-9005-cf8da22ee5bc tempest-VolumesActionsTest-1413902119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:18 devstack sudo[103543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:48:18 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:18 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-90be6a73-4740-47de-9005-cf8da22ee5bc tempest-VolumesActionsTest-1413902119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.281s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:18 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-90be6a73-4740-47de-9005-cf8da22ee5bc tempest-VolumesActionsTest-1413902119 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:48:18 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-90be6a73-4740-47de-9005-cf8da22ee5bc tempest-VolumesActionsTest-1413902119 None] Deleted volume successfully. Sep 05 11:48:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-90be6a73-4740-47de-9005-cf8da22ee5bc tempest-VolumesActionsTest-1413902119 None] Lock "cinder-e999f6d5-b710-4e46-9cf0-17c674671929-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:48:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f168be9d-bea8-46ea-8bbf-fd99b93ec80a tempest-TestStampPattern-1601760735 None] Acquiring lock "cinder-3422dd10-83d9-4853-8b8d-512ac7459d11-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:48:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f168be9d-bea8-46ea-8bbf-fd99b93ec80a tempest-TestStampPattern-1601760735 None] Lock "cinder-3422dd10-83d9-4853-8b8d-512ac7459d11-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:48:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f168be9d-bea8-46ea-8bbf-fd99b93ec80a tempest-TestStampPattern-1601760735 None] Acquiring lock "cinder-quobyte-3422dd10-83d9-4853-8b8d-512ac7459d11" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:48:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f168be9d-bea8-46ea-8bbf-fd99b93ec80a tempest-TestStampPattern-1601760735 None] Lock "cinder-quobyte-3422dd10-83d9-4853-8b8d-512ac7459d11" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:48:21 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[86687b7a-d982-4e8d-8d6c-6ed1ca0dd446]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:48:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f168be9d-bea8-46ea-8bbf-fd99b93ec80a tempest-TestStampPattern-1601760735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:22 devstack sudo[103575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11 Sep 05 11:48:22 devstack sudo[103575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:22 devstack sudo[103575]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f168be9d-bea8-46ea-8bbf-fd99b93ec80a tempest-TestStampPattern-1601760735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11" returned: 0 in 0.344s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f168be9d-bea8-46ea-8bbf-fd99b93ec80a tempest-TestStampPattern-1601760735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:22 devstack sudo[103581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11 Sep 05 11:48:22 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:22 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f168be9d-bea8-46ea-8bbf-fd99b93ec80a tempest-TestStampPattern-1601760735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3422dd10-83d9-4853-8b8d-512ac7459d11" returned: 0 in 0.244s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f168be9d-bea8-46ea-8bbf-fd99b93ec80a tempest-TestStampPattern-1601760735 None] Lock "cinder-quobyte-3422dd10-83d9-4853-8b8d-512ac7459d11" released by "delete_volume" :: held 0.668s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:48:22 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-f168be9d-bea8-46ea-8bbf-fd99b93ec80a tempest-TestStampPattern-1601760735 None] Created reservations ['60faea0f-835c-4b3b-b939-2b8071a30d96', '235102c7-9429-4682-891f-8c8f20f182d0', 'bf6eeae4-f798-4747-9042-6e4cc330b574', 'c0f0dd3d-ef97-4e85-895a-de9cea8bd2cf'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:48:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f168be9d-bea8-46ea-8bbf-fd99b93ec80a tempest-TestStampPattern-1601760735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f168be9d-bea8-46ea-8bbf-fd99b93ec80a tempest-TestStampPattern-1601760735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f168be9d-bea8-46ea-8bbf-fd99b93ec80a tempest-TestStampPattern-1601760735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:48:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f168be9d-bea8-46ea-8bbf-fd99b93ec80a tempest-TestStampPattern-1601760735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:48:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f168be9d-bea8-46ea-8bbf-fd99b93ec80a tempest-TestStampPattern-1601760735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f168be9d-bea8-46ea-8bbf-fd99b93ec80a tempest-TestStampPattern-1601760735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:22 devstack sudo[103584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:48:22 devstack sudo[103584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:22 devstack sudo[103584]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f168be9d-bea8-46ea-8bbf-fd99b93ec80a tempest-TestStampPattern-1601760735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.307s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:22 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-f168be9d-bea8-46ea-8bbf-fd99b93ec80a tempest-TestStampPattern-1601760735 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:48:22 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f168be9d-bea8-46ea-8bbf-fd99b93ec80a tempest-TestStampPattern-1601760735 None] Deleted volume successfully. Sep 05 11:48:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f168be9d-bea8-46ea-8bbf-fd99b93ec80a tempest-TestStampPattern-1601760735 None] Lock "cinder-3422dd10-83d9-4853-8b8d-512ac7459d11-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:48:30 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:48:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] Flow 'volume_create_manager' (90d1fe40-e115-4652-80c6-b07e38ff74c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:48:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccfdb768-2320-4729-a810-eb9711d817f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccfdb768-2320-4729-a810-eb9711d817f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1763173579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1cba505-f14f-4c81-9ffe-0a6e1aed37fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='258ef4b6c77c40a78b1bc01a0563aa61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:48:30Z,use_quota=True,user_id='1b0ba485ac204f6f98d2ef58359c23c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce885e3b-2fc0-419b-82b0-80c6fb485348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce885e3b-2fc0-419b-82b0-80c6fb485348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8092f0da-2c6c-4df2-bbe1-a8171bfff890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8092f0da-2c6c-4df2-bbe1-a8171bfff890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1cba505-f14f-4c81-9ffe-0a6e1aed37fd', 'volume_name': 'volume-d1cba505-f14f-4c81-9ffe-0a6e1aed37fd', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f82c5db-c92a-4897-b175-7272d835624d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f82c5db-c92a-4897-b175-7272d835624d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (239e92ee-43df-44de-bdb5-fe35b0797fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:30 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] Volume d1cba505-f14f-4c81-9ffe-0a6e1aed37fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1cba505-f14f-4c81-9ffe-0a6e1aed37fd', 'volume_size': 1} Sep 05 11:48:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1763173579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1cba505-f14f-4c81-9ffe-0a6e1aed37fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='258ef4b6c77c40a78b1bc01a0563aa61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:48:30Z,use_quota=True,user_id='1b0ba485ac204f6f98d2ef58359c23c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:48:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] Creating volume d1cba505-f14f-4c81-9ffe-0a6e1aed37fd {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:48:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:48:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:48:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:48:30 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:48:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1cba505-f14f-4c81-9ffe-0a6e1aed37fd 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:30 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1cba505-f14f-4c81-9ffe-0a6e1aed37fd 1073741824 Sep 05 11:48:30 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:30 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1cba505-f14f-4c81-9ffe-0a6e1aed37fd 1073741824" returned: 0 in 0.409s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1cba505-f14f-4c81-9ffe-0a6e1aed37fd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:30 devstack sudo[103599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1cba505-f14f-4c81-9ffe-0a6e1aed37fd Sep 05 11:48:30 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:31 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1cba505-f14f-4c81-9ffe-0a6e1aed37fd" returned: 0 in 0.252s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:48:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (239e92ee-43df-44de-bdb5-fe35b0797fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1cba505-f14f-4c81-9ffe-0a6e1aed37fd', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8427cdc-b982-4f5b-b4ac-55bd6e050e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:31 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] Volume volume-d1cba505-f14f-4c81-9ffe-0a6e1aed37fd (d1cba505-f14f-4c81-9ffe-0a6e1aed37fd): created successfully Sep 05 11:48:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8427cdc-b982-4f5b-b4ac-55bd6e050e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:31 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] Flow 'volume_create_manager' (90d1fe40-e115-4652-80c6-b07e38ff74c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:48:31 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-387ce86f-9261-4b10-8a36-8b5ec19d5f2d tempest-VolumesNegativeTest-404109490 None] Created volume successfully. Sep 05 11:48:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:48:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:48:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:48:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:32 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:48:32 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:32 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.278s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:32 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:48:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:48:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread count: 28 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 11:48:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread info: [<_MainThread(MainThread, started 131707869511808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 11:48:35 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:48:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] Flow 'volume_create_manager' (7c0d01c9-957c-472c-9e6c-eba06efc24b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:48:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16257188-29a3-4198-9210-db9023506413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16257188-29a3-4198-9210-db9023506413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1282351457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5318cdb1-8c7c-4a65-b702-42fa8426794f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c193189d47f846b5ba6a69295e547285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:48:36Z,use_quota=True,user_id='65cd3ec5bf8742be986eb1a389eac29f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (948630c3-6584-48c3-9350-ffb127b26b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (948630c3-6584-48c3-9350-ffb127b26b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba192d9-ab22-47f3-a9b7-7e30af0bcea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba192d9-ab22-47f3-a9b7-7e30af0bcea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5318cdb1-8c7c-4a65-b702-42fa8426794f', 'volume_name': 'volume-5318cdb1-8c7c-4a65-b702-42fa8426794f', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5809a59-4534-41ae-9835-5e29403d6745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:35 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5809a59-4534-41ae-9835-5e29403d6745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd75911-08ef-40fa-9874-ea5834b9e894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:36 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] Volume 5318cdb1-8c7c-4a65-b702-42fa8426794f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5318cdb1-8c7c-4a65-b702-42fa8426794f', 'volume_size': 1} Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1282351457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5318cdb1-8c7c-4a65-b702-42fa8426794f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c193189d47f846b5ba6a69295e547285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:48:36Z,use_quota=True,user_id='65cd3ec5bf8742be986eb1a389eac29f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] Creating volume 5318cdb1-8c7c-4a65-b702-42fa8426794f {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:48:36 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5318cdb1-8c7c-4a65-b702-42fa8426794f 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:36 devstack sudo[103664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5318cdb1-8c7c-4a65-b702-42fa8426794f 1073741824 Sep 05 11:48:36 devstack sudo[103664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] Flow 'volume_create_manager' (dda69b00-cd2e-4faa-96d6-d43e87ef906b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021b86a5-ad43-495e-bd93-d9b245011c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021b86a5-ad43-495e-bd93-d9b245011c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1652979894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=554d7e50-bddc-45ab-8706-b43220b24520,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c193189d47f846b5ba6a69295e547285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:48:36Z,use_quota=True,user_id='65cd3ec5bf8742be986eb1a389eac29f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a3bf8a-5514-46a3-8fc2-f0cacedf1067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a3bf8a-5514-46a3-8fc2-f0cacedf1067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6844ab81-7d72-4c8a-8ab3-f92b0b9ed4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6844ab81-7d72-4c8a-8ab3-f92b0b9ed4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '554d7e50-bddc-45ab-8706-b43220b24520', 'volume_name': 'volume-554d7e50-bddc-45ab-8706-b43220b24520', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f25130b-2818-455d-9ea4-23d7a2839afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f25130b-2818-455d-9ea4-23d7a2839afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64743343-efea-40b6-a4d8-af5a681f7bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:36 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] Volume 554d7e50-bddc-45ab-8706-b43220b24520: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-554d7e50-bddc-45ab-8706-b43220b24520', 'volume_size': 1} Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:36 devstack sudo[103664]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5318cdb1-8c7c-4a65-b702-42fa8426794f 1073741824" returned: 0 in 0.573s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5318cdb1-8c7c-4a65-b702-42fa8426794f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:36 devstack sudo[103671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5318cdb1-8c7c-4a65-b702-42fa8426794f Sep 05 11:48:36 devstack sudo[103671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] Flow 'volume_create_manager' (e4d61f04-85a9-4a75-95dc-8a08e3f58794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a57237-2d28-4575-9d4d-a4289e77769f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a57237-2d28-4575-9d4d-a4289e77769f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1453843672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51661f16-4c76-45d2-bc03-85a40b9fe07c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c193189d47f846b5ba6a69295e547285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:48:37Z,use_quota=True,user_id='65cd3ec5bf8742be986eb1a389eac29f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:36 devstack sudo[103671]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ecb03fa-432e-4e83-9ff7-9070831b7c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ecb03fa-432e-4e83-9ff7-9070831b7c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b22d7b1-4667-4b33-8914-21f5d8a1901d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b22d7b1-4667-4b33-8914-21f5d8a1901d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51661f16-4c76-45d2-bc03-85a40b9fe07c', 'volume_name': 'volume-51661f16-4c76-45d2-bc03-85a40b9fe07c', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (370a15fe-c7a3-48cf-9d67-40ed14955dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (370a15fe-c7a3-48cf-9d67-40ed14955dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d43bf58e-8437-4a84-bde2-75ac326fb7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:37 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] Volume 51661f16-4c76-45d2-bc03-85a40b9fe07c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51661f16-4c76-45d2-bc03-85a40b9fe07c', 'volume_size': 1} Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5318cdb1-8c7c-4a65-b702-42fa8426794f" returned: 0 in 0.374s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.562s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1652979894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=554d7e50-bddc-45ab-8706-b43220b24520,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c193189d47f846b5ba6a69295e547285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:48:36Z,use_quota=True,user_id='65cd3ec5bf8742be986eb1a389eac29f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] Creating volume 554d7e50-bddc-45ab-8706-b43220b24520 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:48:37 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-554d7e50-bddc-45ab-8706-b43220b24520 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd75911-08ef-40fa-9874-ea5834b9e894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5318cdb1-8c7c-4a65-b702-42fa8426794f', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:37 devstack sudo[103674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-554d7e50-bddc-45ab-8706-b43220b24520 1073741824 Sep 05 11:48:37 devstack sudo[103674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51768517-26cc-4191-af3f-ac136554d472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:37 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] Volume volume-5318cdb1-8c7c-4a65-b702-42fa8426794f (5318cdb1-8c7c-4a65-b702-42fa8426794f): created successfully Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51768517-26cc-4191-af3f-ac136554d472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] Flow 'volume_create_manager' (7c0d01c9-957c-472c-9e6c-eba06efc24b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:48:37 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-cf4d1a62-2fa6-479a-bb06-a847a63b1e2a tempest-CreateVolumesFromImageTest-128432266 None] Created volume successfully. Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] Flow 'volume_create_manager' (9f09f747-2589-4e49-a7a2-332fd60bc175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2e023ab-71a1-40d5-8ac7-e128096d1a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2e023ab-71a1-40d5-8ac7-e128096d1a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-873014305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f57249df-e199-4021-a870-08826623e78e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c193189d47f846b5ba6a69295e547285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:48:37Z,use_quota=True,user_id='65cd3ec5bf8742be986eb1a389eac29f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3317c775-a247-41b0-a0ac-da0dfce79b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3317c775-a247-41b0-a0ac-da0dfce79b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1121e425-aace-4252-9720-d163bfee040e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1121e425-aace-4252-9720-d163bfee040e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f57249df-e199-4021-a870-08826623e78e', 'volume_name': 'volume-f57249df-e199-4021-a870-08826623e78e', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b5be46a-c128-4374-a062-50891ddd3b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b5be46a-c128-4374-a062-50891ddd3b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad434960-c4ff-44e7-afb0-d49cf1b6194b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:37 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] Volume f57249df-e199-4021-a870-08826623e78e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f57249df-e199-4021-a870-08826623e78e', 'volume_size': 1} Sep 05 11:48:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:38 devstack sudo[103674]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-554d7e50-bddc-45ab-8706-b43220b24520 1073741824" returned: 0 in 1.105s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-554d7e50-bddc-45ab-8706-b43220b24520 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:38 devstack sudo[103732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-554d7e50-bddc-45ab-8706-b43220b24520 Sep 05 11:48:38 devstack sudo[103732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:38 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:48:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] Flow 'volume_create_manager' (726f7788-f16c-4630-9d3d-45f028c9ae06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:48:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e05d0cd5-598e-4670-bfb2-c327c01c1ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e05d0cd5-598e-4670-bfb2-c327c01c1ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-439270109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e3d1f2-5ff9-44ad-8f05-459db07cbafe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c193189d47f846b5ba6a69295e547285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:48:38Z,use_quota=True,user_id='65cd3ec5bf8742be986eb1a389eac29f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b107f16-6698-44b1-88fd-166dff2368a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b107f16-6698-44b1-88fd-166dff2368a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8be7b77e-5ba6-4f04-8b82-75e2d9bbe105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8be7b77e-5ba6-4f04-8b82-75e2d9bbe105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38e3d1f2-5ff9-44ad-8f05-459db07cbafe', 'volume_name': 'volume-38e3d1f2-5ff9-44ad-8f05-459db07cbafe', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de084153-6972-4789-860b-23ea5dd6e3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de084153-6972-4789-860b-23ea5dd6e3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bddd88a9-2cc2-42d9-b6e5-413690deab5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:38 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] Volume 38e3d1f2-5ff9-44ad-8f05-459db07cbafe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38e3d1f2-5ff9-44ad-8f05-459db07cbafe', 'volume_size': 1} Sep 05 11:48:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:38 devstack sudo[103732]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-554d7e50-bddc-45ab-8706-b43220b24520" returned: 0 in 0.485s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:48:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.717s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1453843672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51661f16-4c76-45d2-bc03-85a40b9fe07c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c193189d47f846b5ba6a69295e547285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:48:37Z,use_quota=True,user_id='65cd3ec5bf8742be986eb1a389eac29f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:48:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] Creating volume 51661f16-4c76-45d2-bc03-85a40b9fe07c {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:48:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:48:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:48:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:48:38 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:48:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-51661f16-4c76-45d2-bc03-85a40b9fe07c 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:38 devstack sudo[103745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-51661f16-4c76-45d2-bc03-85a40b9fe07c 1073741824 Sep 05 11:48:38 devstack sudo[103745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64743343-efea-40b6-a4d8-af5a681f7bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-554d7e50-bddc-45ab-8706-b43220b24520', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b1823a-b909-4874-b1f6-d70906429bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:38 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] Volume volume-554d7e50-bddc-45ab-8706-b43220b24520 (554d7e50-bddc-45ab-8706-b43220b24520): created successfully Sep 05 11:48:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b1823a-b909-4874-b1f6-d70906429bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] Flow 'volume_create_manager' (dda69b00-cd2e-4faa-96d6-d43e87ef906b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:48:38 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-45dcf785-818f-45b0-88bc-8dfd5ed6df61 tempest-CreateVolumesFromImageTest-128432266 None] Created volume successfully. Sep 05 11:48:39 devstack sudo[103745]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-51661f16-4c76-45d2-bc03-85a40b9fe07c 1073741824" returned: 0 in 0.626s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-51661f16-4c76-45d2-bc03-85a40b9fe07c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:39 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-51661f16-4c76-45d2-bc03-85a40b9fe07c Sep 05 11:48:39 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:39 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-51661f16-4c76-45d2-bc03-85a40b9fe07c" returned: 0 in 0.293s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:48:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.926s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-873014305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f57249df-e199-4021-a870-08826623e78e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c193189d47f846b5ba6a69295e547285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:48:37Z,use_quota=True,user_id='65cd3ec5bf8742be986eb1a389eac29f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:48:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] Creating volume f57249df-e199-4021-a870-08826623e78e {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:48:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:48:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:48:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:48:39 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:48:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f57249df-e199-4021-a870-08826623e78e 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d43bf58e-8437-4a84-bde2-75ac326fb7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51661f16-4c76-45d2-bc03-85a40b9fe07c', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:39 devstack sudo[103761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f57249df-e199-4021-a870-08826623e78e 1073741824 Sep 05 11:48:39 devstack sudo[103761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a055c0b1-bb82-42e1-8460-537fd56c2da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:39 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] Volume volume-51661f16-4c76-45d2-bc03-85a40b9fe07c (51661f16-4c76-45d2-bc03-85a40b9fe07c): created successfully Sep 05 11:48:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a055c0b1-bb82-42e1-8460-537fd56c2da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] Flow 'volume_create_manager' (e4d61f04-85a9-4a75-95dc-8a08e3f58794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:48:39 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2aa9e6c5-d870-4f7e-b333-14d71ae55d8e tempest-CreateVolumesFromImageTest-128432266 None] Created volume successfully. Sep 05 11:48:40 devstack sudo[103761]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f57249df-e199-4021-a870-08826623e78e 1073741824" returned: 0 in 0.516s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f57249df-e199-4021-a870-08826623e78e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:40 devstack sudo[103767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f57249df-e199-4021-a870-08826623e78e Sep 05 11:48:40 devstack sudo[103767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:40 devstack sudo[103767]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f57249df-e199-4021-a870-08826623e78e" returned: 0 in 0.327s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:48:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.966s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-439270109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e3d1f2-5ff9-44ad-8f05-459db07cbafe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c193189d47f846b5ba6a69295e547285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:48:38Z,use_quota=True,user_id='65cd3ec5bf8742be986eb1a389eac29f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:48:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] Creating volume 38e3d1f2-5ff9-44ad-8f05-459db07cbafe {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:48:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:48:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:48:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:48:40 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:48:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-38e3d1f2-5ff9-44ad-8f05-459db07cbafe 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad434960-c4ff-44e7-afb0-d49cf1b6194b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f57249df-e199-4021-a870-08826623e78e', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:40 devstack sudo[103770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-38e3d1f2-5ff9-44ad-8f05-459db07cbafe 1073741824 Sep 05 11:48:40 devstack sudo[103770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f5842c3-d581-4634-8519-66290e94c33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:40 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] Volume volume-f57249df-e199-4021-a870-08826623e78e (f57249df-e199-4021-a870-08826623e78e): created successfully Sep 05 11:48:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f5842c3-d581-4634-8519-66290e94c33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] Flow 'volume_create_manager' (9f09f747-2589-4e49-a7a2-332fd60bc175) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:48:40 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6bc809a5-7ade-47cc-9bd5-d1296d00e160 tempest-CreateVolumesFromImageTest-128432266 None] Created volume successfully. Sep 05 11:48:41 devstack sudo[103770]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-38e3d1f2-5ff9-44ad-8f05-459db07cbafe 1073741824" returned: 0 in 0.533s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-38e3d1f2-5ff9-44ad-8f05-459db07cbafe {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:41 devstack sudo[103795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-38e3d1f2-5ff9-44ad-8f05-459db07cbafe Sep 05 11:48:41 devstack sudo[103795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:41 devstack sudo[103795]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-38e3d1f2-5ff9-44ad-8f05-459db07cbafe" returned: 0 in 0.301s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:48:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bddd88a9-2cc2-42d9-b6e5-413690deab5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38e3d1f2-5ff9-44ad-8f05-459db07cbafe', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0bc6836-410b-4e29-b8ea-7c0857b7cdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:41 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] Volume volume-38e3d1f2-5ff9-44ad-8f05-459db07cbafe (38e3d1f2-5ff9-44ad-8f05-459db07cbafe): created successfully Sep 05 11:48:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0bc6836-410b-4e29-b8ea-7c0857b7cdfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] Flow 'volume_create_manager' (726f7788-f16c-4630-9d3d-45f028c9ae06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:48:41 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d0f69cc1-72db-4efd-aea1-47eac33a1ee7 tempest-CreateVolumesFromImageTest-128432266 None] Created volume successfully. Sep 05 11:48:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-73072bba-91ff-4017-98e7-03e77d6d2c88 tempest-CreateVolumesFromImageTest-128432266 None] Acquiring lock "cinder-38e3d1f2-5ff9-44ad-8f05-459db07cbafe-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:48:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-73072bba-91ff-4017-98e7-03e77d6d2c88 tempest-CreateVolumesFromImageTest-128432266 None] Lock "cinder-38e3d1f2-5ff9-44ad-8f05-459db07cbafe-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:48:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-73072bba-91ff-4017-98e7-03e77d6d2c88 tempest-CreateVolumesFromImageTest-128432266 None] Acquiring lock "cinder-quobyte-38e3d1f2-5ff9-44ad-8f05-459db07cbafe" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:48:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-73072bba-91ff-4017-98e7-03e77d6d2c88 tempest-CreateVolumesFromImageTest-128432266 None] Lock "cinder-quobyte-38e3d1f2-5ff9-44ad-8f05-459db07cbafe" acquired by "delete_volume" :: waited 0.028s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:48:41 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[742b674c-23b9-4d1f-9ac7-9745b0a3daa7]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:48:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-73072bba-91ff-4017-98e7-03e77d6d2c88 tempest-CreateVolumesFromImageTest-128432266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-38e3d1f2-5ff9-44ad-8f05-459db07cbafe {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:42 devstack sudo[103801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-38e3d1f2-5ff9-44ad-8f05-459db07cbafe Sep 05 11:48:42 devstack sudo[103801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:42 devstack sudo[103801]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-73072bba-91ff-4017-98e7-03e77d6d2c88 tempest-CreateVolumesFromImageTest-128432266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-38e3d1f2-5ff9-44ad-8f05-459db07cbafe" returned: 0 in 0.400s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-73072bba-91ff-4017-98e7-03e77d6d2c88 tempest-CreateVolumesFromImageTest-128432266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-38e3d1f2-5ff9-44ad-8f05-459db07cbafe {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:42 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-38e3d1f2-5ff9-44ad-8f05-459db07cbafe Sep 05 11:48:42 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:42 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-73072bba-91ff-4017-98e7-03e77d6d2c88 tempest-CreateVolumesFromImageTest-128432266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-38e3d1f2-5ff9-44ad-8f05-459db07cbafe" returned: 0 in 0.263s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-73072bba-91ff-4017-98e7-03e77d6d2c88 tempest-CreateVolumesFromImageTest-128432266 None] Lock "cinder-quobyte-38e3d1f2-5ff9-44ad-8f05-459db07cbafe" released by "delete_volume" :: held 0.723s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:48:42 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-73072bba-91ff-4017-98e7-03e77d6d2c88 tempest-CreateVolumesFromImageTest-128432266 None] Created reservations ['0caa5ace-61f2-4d8f-8232-741d33fd49b3', '71fe7acd-6524-44d0-87bf-db78eec038e9', '5440472b-b2a9-4572-be13-b6dcb049fcb7', 'ea6f01d9-874a-4a8c-96fd-7b7dd5228608'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:48:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-73072bba-91ff-4017-98e7-03e77d6d2c88 tempest-CreateVolumesFromImageTest-128432266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-73072bba-91ff-4017-98e7-03e77d6d2c88 tempest-CreateVolumesFromImageTest-128432266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-73072bba-91ff-4017-98e7-03e77d6d2c88 tempest-CreateVolumesFromImageTest-128432266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:48:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-73072bba-91ff-4017-98e7-03e77d6d2c88 tempest-CreateVolumesFromImageTest-128432266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:48:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-73072bba-91ff-4017-98e7-03e77d6d2c88 tempest-CreateVolumesFromImageTest-128432266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-73072bba-91ff-4017-98e7-03e77d6d2c88 tempest-CreateVolumesFromImageTest-128432266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:42 devstack sudo[103811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:48:42 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b0c7c31f-3e2c-4e5f-9e61-b4648bd9446e tempest-CreateVolumesFromImageTest-128432266 None] Acquiring lock "cinder-f57249df-e199-4021-a870-08826623e78e-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:48:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b0c7c31f-3e2c-4e5f-9e61-b4648bd9446e tempest-CreateVolumesFromImageTest-128432266 None] Lock "cinder-f57249df-e199-4021-a870-08826623e78e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:48:42 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-73072bba-91ff-4017-98e7-03e77d6d2c88 tempest-CreateVolumesFromImageTest-128432266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.265s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:42 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-73072bba-91ff-4017-98e7-03e77d6d2c88 tempest-CreateVolumesFromImageTest-128432266 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:48:42 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-73072bba-91ff-4017-98e7-03e77d6d2c88 tempest-CreateVolumesFromImageTest-128432266 None] Deleted volume successfully. Sep 05 11:48:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-73072bba-91ff-4017-98e7-03e77d6d2c88 tempest-CreateVolumesFromImageTest-128432266 None] Lock "cinder-38e3d1f2-5ff9-44ad-8f05-459db07cbafe-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:48:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b0c7c31f-3e2c-4e5f-9e61-b4648bd9446e tempest-CreateVolumesFromImageTest-128432266 None] Acquiring lock "cinder-quobyte-f57249df-e199-4021-a870-08826623e78e" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:48:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b0c7c31f-3e2c-4e5f-9e61-b4648bd9446e tempest-CreateVolumesFromImageTest-128432266 None] Lock "cinder-quobyte-f57249df-e199-4021-a870-08826623e78e" acquired by "delete_volume" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:48:43 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ac763f-917b-419d-bde0-e2e7c87eecb0]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:48:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b0c7c31f-3e2c-4e5f-9e61-b4648bd9446e tempest-CreateVolumesFromImageTest-128432266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f57249df-e199-4021-a870-08826623e78e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:43 devstack sudo[103814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f57249df-e199-4021-a870-08826623e78e Sep 05 11:48:43 devstack sudo[103814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:43 devstack sudo[103814]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b0c7c31f-3e2c-4e5f-9e61-b4648bd9446e tempest-CreateVolumesFromImageTest-128432266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f57249df-e199-4021-a870-08826623e78e" returned: 0 in 0.374s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b0c7c31f-3e2c-4e5f-9e61-b4648bd9446e tempest-CreateVolumesFromImageTest-128432266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f57249df-e199-4021-a870-08826623e78e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:43 devstack sudo[103819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f57249df-e199-4021-a870-08826623e78e Sep 05 11:48:43 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:43 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b0c7c31f-3e2c-4e5f-9e61-b4648bd9446e tempest-CreateVolumesFromImageTest-128432266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f57249df-e199-4021-a870-08826623e78e" returned: 0 in 0.262s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b0c7c31f-3e2c-4e5f-9e61-b4648bd9446e tempest-CreateVolumesFromImageTest-128432266 None] Lock "cinder-quobyte-f57249df-e199-4021-a870-08826623e78e" released by "delete_volume" :: held 0.694s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:48:43 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-b0c7c31f-3e2c-4e5f-9e61-b4648bd9446e tempest-CreateVolumesFromImageTest-128432266 None] Created reservations ['24475f34-812b-4644-bf5b-995d1de71a3a', 'a0167a85-6800-4d88-8ff8-651c534f664d', 'fbcfb379-d874-483d-b68c-de83e65193cd', '818f7986-559f-4780-9d9c-0d442b252c31'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:48:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b0c7c31f-3e2c-4e5f-9e61-b4648bd9446e tempest-CreateVolumesFromImageTest-128432266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b0c7c31f-3e2c-4e5f-9e61-b4648bd9446e tempest-CreateVolumesFromImageTest-128432266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b0c7c31f-3e2c-4e5f-9e61-b4648bd9446e tempest-CreateVolumesFromImageTest-128432266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:48:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b0c7c31f-3e2c-4e5f-9e61-b4648bd9446e tempest-CreateVolumesFromImageTest-128432266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:48:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b0c7c31f-3e2c-4e5f-9e61-b4648bd9446e tempest-CreateVolumesFromImageTest-128432266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b0c7c31f-3e2c-4e5f-9e61-b4648bd9446e tempest-CreateVolumesFromImageTest-128432266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:43 devstack sudo[103822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:48:43 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:44 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b0c7c31f-3e2c-4e5f-9e61-b4648bd9446e tempest-CreateVolumesFromImageTest-128432266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.251s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:44 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-b0c7c31f-3e2c-4e5f-9e61-b4648bd9446e tempest-CreateVolumesFromImageTest-128432266 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:48:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8ad8c7a6-e71d-48a4-b97a-26d15a7b2c47 tempest-CreateVolumesFromImageTest-128432266 None] Acquiring lock "cinder-51661f16-4c76-45d2-bc03-85a40b9fe07c-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:48:44 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b0c7c31f-3e2c-4e5f-9e61-b4648bd9446e tempest-CreateVolumesFromImageTest-128432266 None] Deleted volume successfully. Sep 05 11:48:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8ad8c7a6-e71d-48a4-b97a-26d15a7b2c47 tempest-CreateVolumesFromImageTest-128432266 None] Lock "cinder-51661f16-4c76-45d2-bc03-85a40b9fe07c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:48:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b0c7c31f-3e2c-4e5f-9e61-b4648bd9446e tempest-CreateVolumesFromImageTest-128432266 None] Lock "cinder-f57249df-e199-4021-a870-08826623e78e-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:48:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8ad8c7a6-e71d-48a4-b97a-26d15a7b2c47 tempest-CreateVolumesFromImageTest-128432266 None] Acquiring lock "cinder-quobyte-51661f16-4c76-45d2-bc03-85a40b9fe07c" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:48:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8ad8c7a6-e71d-48a4-b97a-26d15a7b2c47 tempest-CreateVolumesFromImageTest-128432266 None] Lock "cinder-quobyte-51661f16-4c76-45d2-bc03-85a40b9fe07c" acquired by "delete_volume" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:48:44 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[3490a003-474e-4acb-a523-e693ee2998d2]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:48:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8ad8c7a6-e71d-48a4-b97a-26d15a7b2c47 tempest-CreateVolumesFromImageTest-128432266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-51661f16-4c76-45d2-bc03-85a40b9fe07c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:44 devstack sudo[103825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-51661f16-4c76-45d2-bc03-85a40b9fe07c Sep 05 11:48:44 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:44 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8ad8c7a6-e71d-48a4-b97a-26d15a7b2c47 tempest-CreateVolumesFromImageTest-128432266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-51661f16-4c76-45d2-bc03-85a40b9fe07c" returned: 0 in 0.371s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8ad8c7a6-e71d-48a4-b97a-26d15a7b2c47 tempest-CreateVolumesFromImageTest-128432266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-51661f16-4c76-45d2-bc03-85a40b9fe07c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:44 devstack sudo[103830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-51661f16-4c76-45d2-bc03-85a40b9fe07c Sep 05 11:48:44 devstack sudo[103830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:44 devstack sudo[103830]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8ad8c7a6-e71d-48a4-b97a-26d15a7b2c47 tempest-CreateVolumesFromImageTest-128432266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-51661f16-4c76-45d2-bc03-85a40b9fe07c" returned: 0 in 0.256s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8ad8c7a6-e71d-48a4-b97a-26d15a7b2c47 tempest-CreateVolumesFromImageTest-128432266 None] Lock "cinder-quobyte-51661f16-4c76-45d2-bc03-85a40b9fe07c" released by "delete_volume" :: held 0.666s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:48:44 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-8ad8c7a6-e71d-48a4-b97a-26d15a7b2c47 tempest-CreateVolumesFromImageTest-128432266 None] Created reservations ['265f94f1-eb00-4d6e-8c66-3579e36570fe', 'd157b23b-4689-4011-a170-c9e56355253d', '87a27d19-46f2-455c-a4d6-4920a85be174', 'f62ab78d-4f60-465c-9c91-3ee1fe428a95'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:48:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8ad8c7a6-e71d-48a4-b97a-26d15a7b2c47 tempest-CreateVolumesFromImageTest-128432266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8ad8c7a6-e71d-48a4-b97a-26d15a7b2c47 tempest-CreateVolumesFromImageTest-128432266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8ad8c7a6-e71d-48a4-b97a-26d15a7b2c47 tempest-CreateVolumesFromImageTest-128432266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:48:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8ad8c7a6-e71d-48a4-b97a-26d15a7b2c47 tempest-CreateVolumesFromImageTest-128432266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:48:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8ad8c7a6-e71d-48a4-b97a-26d15a7b2c47 tempest-CreateVolumesFromImageTest-128432266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8ad8c7a6-e71d-48a4-b97a-26d15a7b2c47 tempest-CreateVolumesFromImageTest-128432266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:45 devstack sudo[103833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:48:45 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:45 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8ad8c7a6-e71d-48a4-b97a-26d15a7b2c47 tempest-CreateVolumesFromImageTest-128432266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.284s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:45 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-8ad8c7a6-e71d-48a4-b97a-26d15a7b2c47 tempest-CreateVolumesFromImageTest-128432266 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:48:45 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-8ad8c7a6-e71d-48a4-b97a-26d15a7b2c47 tempest-CreateVolumesFromImageTest-128432266 None] Deleted volume successfully. Sep 05 11:48:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fb4b106f-7192-469e-bcd4-9f3ce63cf4e1 tempest-CreateVolumesFromImageTest-128432266 None] Acquiring lock "cinder-554d7e50-bddc-45ab-8706-b43220b24520-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:48:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fb4b106f-7192-469e-bcd4-9f3ce63cf4e1 tempest-CreateVolumesFromImageTest-128432266 None] Lock "cinder-554d7e50-bddc-45ab-8706-b43220b24520-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:48:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8ad8c7a6-e71d-48a4-b97a-26d15a7b2c47 tempest-CreateVolumesFromImageTest-128432266 None] Lock "cinder-51661f16-4c76-45d2-bc03-85a40b9fe07c-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:48:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fb4b106f-7192-469e-bcd4-9f3ce63cf4e1 tempest-CreateVolumesFromImageTest-128432266 None] Acquiring lock "cinder-quobyte-554d7e50-bddc-45ab-8706-b43220b24520" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:48:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fb4b106f-7192-469e-bcd4-9f3ce63cf4e1 tempest-CreateVolumesFromImageTest-128432266 None] Lock "cinder-quobyte-554d7e50-bddc-45ab-8706-b43220b24520" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:48:45 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a85b321-9b53-4227-9880-36966d556752]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:48:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fb4b106f-7192-469e-bcd4-9f3ce63cf4e1 tempest-CreateVolumesFromImageTest-128432266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-554d7e50-bddc-45ab-8706-b43220b24520 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:45 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-554d7e50-bddc-45ab-8706-b43220b24520 Sep 05 11:48:45 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:45 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fb4b106f-7192-469e-bcd4-9f3ce63cf4e1 tempest-CreateVolumesFromImageTest-128432266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-554d7e50-bddc-45ab-8706-b43220b24520" returned: 0 in 0.378s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fb4b106f-7192-469e-bcd4-9f3ce63cf4e1 tempest-CreateVolumesFromImageTest-128432266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-554d7e50-bddc-45ab-8706-b43220b24520 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:45 devstack sudo[103843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-554d7e50-bddc-45ab-8706-b43220b24520 Sep 05 11:48:45 devstack sudo[103843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:46 devstack sudo[103843]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fb4b106f-7192-469e-bcd4-9f3ce63cf4e1 tempest-CreateVolumesFromImageTest-128432266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-554d7e50-bddc-45ab-8706-b43220b24520" returned: 0 in 0.254s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fb4b106f-7192-469e-bcd4-9f3ce63cf4e1 tempest-CreateVolumesFromImageTest-128432266 None] Lock "cinder-quobyte-554d7e50-bddc-45ab-8706-b43220b24520" released by "delete_volume" :: held 0.674s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:48:46 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-fb4b106f-7192-469e-bcd4-9f3ce63cf4e1 tempest-CreateVolumesFromImageTest-128432266 None] Created reservations ['079ae233-59f6-41d9-ae25-28c95c5f1914', '5bfce006-4957-467b-8938-50adc681ed21', 'bca13592-d28a-479d-9e47-180dafd20152', '453de468-beb7-4b75-a9b6-aef3b9e1e054'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:48:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fb4b106f-7192-469e-bcd4-9f3ce63cf4e1 tempest-CreateVolumesFromImageTest-128432266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fb4b106f-7192-469e-bcd4-9f3ce63cf4e1 tempest-CreateVolumesFromImageTest-128432266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fb4b106f-7192-469e-bcd4-9f3ce63cf4e1 tempest-CreateVolumesFromImageTest-128432266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:48:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fb4b106f-7192-469e-bcd4-9f3ce63cf4e1 tempest-CreateVolumesFromImageTest-128432266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:48:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fb4b106f-7192-469e-bcd4-9f3ce63cf4e1 tempest-CreateVolumesFromImageTest-128432266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fb4b106f-7192-469e-bcd4-9f3ce63cf4e1 tempest-CreateVolumesFromImageTest-128432266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:46 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:48:46 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:46 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fb4b106f-7192-469e-bcd4-9f3ce63cf4e1 tempest-CreateVolumesFromImageTest-128432266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.247s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:46 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-fb4b106f-7192-469e-bcd4-9f3ce63cf4e1 tempest-CreateVolumesFromImageTest-128432266 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:48:46 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-fb4b106f-7192-469e-bcd4-9f3ce63cf4e1 tempest-CreateVolumesFromImageTest-128432266 None] Deleted volume successfully. Sep 05 11:48:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fb4b106f-7192-469e-bcd4-9f3ce63cf4e1 tempest-CreateVolumesFromImageTest-128432266 None] Lock "cinder-554d7e50-bddc-45ab-8706-b43220b24520-delete_volume" released by "delete_volume" :: held 1.147s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:48:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-528e9727-f829-43df-973c-f464226f5821 tempest-CreateVolumesFromImageTest-128432266 None] Acquiring lock "cinder-5318cdb1-8c7c-4a65-b702-42fa8426794f-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:48:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-528e9727-f829-43df-973c-f464226f5821 tempest-CreateVolumesFromImageTest-128432266 None] Lock "cinder-5318cdb1-8c7c-4a65-b702-42fa8426794f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:48:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-528e9727-f829-43df-973c-f464226f5821 tempest-CreateVolumesFromImageTest-128432266 None] Acquiring lock "cinder-quobyte-5318cdb1-8c7c-4a65-b702-42fa8426794f" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:48:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-528e9727-f829-43df-973c-f464226f5821 tempest-CreateVolumesFromImageTest-128432266 None] Lock "cinder-quobyte-5318cdb1-8c7c-4a65-b702-42fa8426794f" acquired by "delete_volume" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:48:46 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0674a959-45f5-4a2c-90ea-687c85d08e66]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:48:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-528e9727-f829-43df-973c-f464226f5821 tempest-CreateVolumesFromImageTest-128432266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5318cdb1-8c7c-4a65-b702-42fa8426794f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:46 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5318cdb1-8c7c-4a65-b702-42fa8426794f Sep 05 11:48:46 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:46 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-528e9727-f829-43df-973c-f464226f5821 tempest-CreateVolumesFromImageTest-128432266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5318cdb1-8c7c-4a65-b702-42fa8426794f" returned: 0 in 0.373s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-528e9727-f829-43df-973c-f464226f5821 tempest-CreateVolumesFromImageTest-128432266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5318cdb1-8c7c-4a65-b702-42fa8426794f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:47 devstack sudo[103855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5318cdb1-8c7c-4a65-b702-42fa8426794f Sep 05 11:48:47 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:47 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-528e9727-f829-43df-973c-f464226f5821 tempest-CreateVolumesFromImageTest-128432266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5318cdb1-8c7c-4a65-b702-42fa8426794f" returned: 0 in 0.256s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-528e9727-f829-43df-973c-f464226f5821 tempest-CreateVolumesFromImageTest-128432266 None] Lock "cinder-quobyte-5318cdb1-8c7c-4a65-b702-42fa8426794f" released by "delete_volume" :: held 0.680s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:48:47 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-528e9727-f829-43df-973c-f464226f5821 tempest-CreateVolumesFromImageTest-128432266 None] Created reservations ['bf51fca7-8720-4879-979a-b2ad948b925e', '270e67c9-18d2-4858-a019-73675173ed6c', '6729c4a0-61c5-48fc-aaf3-3bdfbb9a4135', '3b19d422-a34f-4822-95f5-48b7f7d80c01'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:48:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-528e9727-f829-43df-973c-f464226f5821 tempest-CreateVolumesFromImageTest-128432266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-528e9727-f829-43df-973c-f464226f5821 tempest-CreateVolumesFromImageTest-128432266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-528e9727-f829-43df-973c-f464226f5821 tempest-CreateVolumesFromImageTest-128432266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:48:47 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-528e9727-f829-43df-973c-f464226f5821 tempest-CreateVolumesFromImageTest-128432266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:48:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-528e9727-f829-43df-973c-f464226f5821 tempest-CreateVolumesFromImageTest-128432266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-528e9727-f829-43df-973c-f464226f5821 tempest-CreateVolumesFromImageTest-128432266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:47 devstack sudo[103858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:48:47 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:47 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-528e9727-f829-43df-973c-f464226f5821 tempest-CreateVolumesFromImageTest-128432266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.263s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:47 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-528e9727-f829-43df-973c-f464226f5821 tempest-CreateVolumesFromImageTest-128432266 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:48:47 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-528e9727-f829-43df-973c-f464226f5821 tempest-CreateVolumesFromImageTest-128432266 None] Deleted volume successfully. Sep 05 11:48:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-528e9727-f829-43df-973c-f464226f5821 tempest-CreateVolumesFromImageTest-128432266 None] Lock "cinder-5318cdb1-8c7c-4a65-b702-42fa8426794f-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:48:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4546de17-b6a5-4a4f-877e-4ddc7c55a412 tempest-VolumesNegativeTest-404109490 None] Acquiring lock "cinder-d1cba505-f14f-4c81-9ffe-0a6e1aed37fd-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:48:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4546de17-b6a5-4a4f-877e-4ddc7c55a412 tempest-VolumesNegativeTest-404109490 None] Lock "cinder-d1cba505-f14f-4c81-9ffe-0a6e1aed37fd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:48:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4546de17-b6a5-4a4f-877e-4ddc7c55a412 tempest-VolumesNegativeTest-404109490 None] Acquiring lock "cinder-quobyte-d1cba505-f14f-4c81-9ffe-0a6e1aed37fd" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:48:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4546de17-b6a5-4a4f-877e-4ddc7c55a412 tempest-VolumesNegativeTest-404109490 None] Lock "cinder-quobyte-d1cba505-f14f-4c81-9ffe-0a6e1aed37fd" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:48:49 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5851bf67-c320-4342-b5d9-7d5a8aaf825f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:48:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4546de17-b6a5-4a4f-877e-4ddc7c55a412 tempest-VolumesNegativeTest-404109490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1cba505-f14f-4c81-9ffe-0a6e1aed37fd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:49 devstack sudo[103862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1cba505-f14f-4c81-9ffe-0a6e1aed37fd Sep 05 11:48:49 devstack sudo[103862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:49 devstack sudo[103862]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4546de17-b6a5-4a4f-877e-4ddc7c55a412 tempest-VolumesNegativeTest-404109490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1cba505-f14f-4c81-9ffe-0a6e1aed37fd" returned: 0 in 0.377s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4546de17-b6a5-4a4f-877e-4ddc7c55a412 tempest-VolumesNegativeTest-404109490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1cba505-f14f-4c81-9ffe-0a6e1aed37fd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:49 devstack sudo[103867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1cba505-f14f-4c81-9ffe-0a6e1aed37fd Sep 05 11:48:49 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:50 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4546de17-b6a5-4a4f-877e-4ddc7c55a412 tempest-VolumesNegativeTest-404109490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1cba505-f14f-4c81-9ffe-0a6e1aed37fd" returned: 0 in 0.249s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4546de17-b6a5-4a4f-877e-4ddc7c55a412 tempest-VolumesNegativeTest-404109490 None] Lock "cinder-quobyte-d1cba505-f14f-4c81-9ffe-0a6e1aed37fd" released by "delete_volume" :: held 0.668s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-4546de17-b6a5-4a4f-877e-4ddc7c55a412 tempest-VolumesNegativeTest-404109490 None] Created reservations ['54311e45-8c4c-4eb5-b3d5-66943dcf626a', '142193d3-9610-4e48-b99e-4d78b07d2062', '68e838a8-d1b7-4309-8ce5-863c2165902e', 'a2d7b0b4-a2ea-44ab-bf56-da1fda2f9284'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4546de17-b6a5-4a4f-877e-4ddc7c55a412 tempest-VolumesNegativeTest-404109490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4546de17-b6a5-4a4f-877e-4ddc7c55a412 tempest-VolumesNegativeTest-404109490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4546de17-b6a5-4a4f-877e-4ddc7c55a412 tempest-VolumesNegativeTest-404109490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4546de17-b6a5-4a4f-877e-4ddc7c55a412 tempest-VolumesNegativeTest-404109490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4546de17-b6a5-4a4f-877e-4ddc7c55a412 tempest-VolumesNegativeTest-404109490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4546de17-b6a5-4a4f-877e-4ddc7c55a412 tempest-VolumesNegativeTest-404109490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:50 devstack sudo[103870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:48:50 devstack sudo[103870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:50 devstack sudo[103870]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4546de17-b6a5-4a4f-877e-4ddc7c55a412 tempest-VolumesNegativeTest-404109490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.255s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-4546de17-b6a5-4a4f-877e-4ddc7c55a412 tempest-VolumesNegativeTest-404109490 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:48:50 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-4546de17-b6a5-4a4f-877e-4ddc7c55a412 tempest-VolumesNegativeTest-404109490 None] Deleted volume successfully. Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4546de17-b6a5-4a4f-877e-4ddc7c55a412 tempest-VolumesNegativeTest-404109490 None] Lock "cinder-d1cba505-f14f-4c81-9ffe-0a6e1aed37fd-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] Flow 'volume_create_manager' (3d38e423-def8-45a9-a663-7ea327e08324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67ac02c2-8303-42e4-bf29-d21d12cd17c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67ac02c2-8303-42e4-bf29-d21d12cd17c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2139439863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea71036b-9ae1-42b8-a2d5-8ffa830c24c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e177582856347edb9e4576d8fa2ba7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:48:51Z,use_quota=True,user_id='7e41de3a69af40c3b964de5b8e843048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bbf5498-f7b1-4a4d-9c43-4f567e37c885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bbf5498-f7b1-4a4d-9c43-4f567e37c885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e67b68c3-117e-48ae-9f45-02205f319ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e67b68c3-117e-48ae-9f45-02205f319ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea71036b-9ae1-42b8-a2d5-8ffa830c24c9', 'volume_name': 'volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2aa3e8e-6b92-4f5a-b465-567a0d0dd49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2aa3e8e-6b92-4f5a-b465-567a0d0dd49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2294895-01cf-446a-8633-cb51631fa9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:50 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] Volume ea71036b-9ae1-42b8-a2d5-8ffa830c24c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9', 'volume_size': 1} Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2139439863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea71036b-9ae1-42b8-a2d5-8ffa830c24c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e177582856347edb9e4576d8fa2ba7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:48:51Z,use_quota=True,user_id='7e41de3a69af40c3b964de5b8e843048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] Creating volume ea71036b-9ae1-42b8-a2d5-8ffa830c24c9 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:48:50 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:48:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:50 devstack sudo[103873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9 1073741824 Sep 05 11:48:50 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:51 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9 1073741824" returned: 0 in 0.424s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:51 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9 Sep 05 11:48:51 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:51 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9" returned: 0 in 0.275s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:48:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2294895-01cf-446a-8633-cb51631fa9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ea4ea2-fc64-4d4a-9715-dc8bad042c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:51 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] Volume volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9 (ea71036b-9ae1-42b8-a2d5-8ffa830c24c9): created successfully Sep 05 11:48:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ea4ea2-fc64-4d4a-9715-dc8bad042c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] Flow 'volume_create_manager' (3d38e423-def8-45a9-a663-7ea327e08324) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:48:51 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e3622905-0ed1-4348-b78b-086e989f5f65 tempest-CreateVolumesFromSnapshotTest-920295763 None] Created volume successfully. Sep 05 11:48:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6130d7da-6c3e-4e55-b840-e54a82a595af tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6130d7da-6c3e-4e55-b840-e54a82a595af tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-6130d7da-6c3e-4e55-b840-e54a82a595af tempest-CreateVolumesFromSnapshotTest-920295763 None] Creating offline snapshot a2b034eb-82f4-4270-894e-5566e3320956 of volume ea71036b-9ae1-42b8-a2d5-8ffa830c24c9 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:48:53 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee28e97-527c-4dda-8d8b-135de253323c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:48:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6130d7da-6c3e-4e55-b840-e54a82a595af tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:53 devstack sudo[103889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9 Sep 05 11:48:53 devstack sudo[103889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:53 devstack sudo[103889]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6130d7da-6c3e-4e55-b840-e54a82a595af tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9" returned: 0 in 0.378s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6130d7da-6c3e-4e55-b840-e54a82a595af tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9.a2b034eb-82f4-4270-894e-5566e3320956 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:53 devstack sudo[103894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9.a2b034eb-82f4-4270-894e-5566e3320956 1G Sep 05 11:48:53 devstack sudo[103894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:53 devstack sudo[103894]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6130d7da-6c3e-4e55-b840-e54a82a595af tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9.a2b034eb-82f4-4270-894e-5566e3320956 1G" returned: 0 in 0.445s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6130d7da-6c3e-4e55-b840-e54a82a595af tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9.a2b034eb-82f4-4270-894e-5566e3320956 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:53 devstack sudo[103899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9.a2b034eb-82f4-4270-894e-5566e3320956 Sep 05 11:48:53 devstack sudo[103899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:54 devstack sudo[103899]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6130d7da-6c3e-4e55-b840-e54a82a595af tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9.a2b034eb-82f4-4270-894e-5566e3320956" returned: 0 in 0.322s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:54 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-6130d7da-6c3e-4e55-b840-e54a82a595af tempest-CreateVolumesFromSnapshotTest-920295763 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9.a2b034eb-82f4-4270-894e-5566e3320956 is being set with open permissions: ugo+rw Sep 05 11:48:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6130d7da-6c3e-4e55-b840-e54a82a595af tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9.a2b034eb-82f4-4270-894e-5566e3320956 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:54 devstack sudo[103904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9.a2b034eb-82f4-4270-894e-5566e3320956 Sep 05 11:48:54 devstack sudo[103904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:54 devstack sudo[103904]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6130d7da-6c3e-4e55-b840-e54a82a595af tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9.a2b034eb-82f4-4270-894e-5566e3320956" returned: 0 in 0.255s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6130d7da-6c3e-4e55-b840-e54a82a595af tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:54 devstack sudo[103907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9.info Sep 05 11:48:54 devstack sudo[103907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:54 devstack sudo[103907]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6130d7da-6c3e-4e55-b840-e54a82a595af tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9.info" returned: 0 in 0.254s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:54 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-6130d7da-6c3e-4e55-b840-e54a82a595af tempest-CreateVolumesFromSnapshotTest-920295763 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9.info is being set with open permissions: ugo+rw Sep 05 11:48:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6130d7da-6c3e-4e55-b840-e54a82a595af tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:54 devstack sudo[103910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9.info Sep 05 11:48:54 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:54 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6130d7da-6c3e-4e55-b840-e54a82a595af tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9.info" returned: 0 in 0.259s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6130d7da-6c3e-4e55-b840-e54a82a595af tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:55 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6130d7da-6c3e-4e55-b840-e54a82a595af tempest-CreateVolumesFromSnapshotTest-920295763 None] Create snapshot completed successfully Sep 05 11:48:56 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:48:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] Flow 'volume_create_manager' (7e0ea1bb-b47c-45cd-86ea-0948b7b69a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:48:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa1b836-3e2b-4c83-8433-ecbb28de176e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa1b836-3e2b-4c83-8433-ecbb28de176e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-585962260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f17157e5-4545-4da0-b88a-3df9153b840a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e177582856347edb9e4576d8fa2ba7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:48:57Z,use_quota=True,user_id='7e41de3a69af40c3b964de5b8e843048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58dc9569-0811-4d9c-b48b-d36fffa0aa04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58dc9569-0811-4d9c-b48b-d36fffa0aa04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54247835-e682-4bc8-aa64-ed3e4a03cc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54247835-e682-4bc8-aa64-ed3e4a03cc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f17157e5-4545-4da0-b88a-3df9153b840a', 'volume_name': 'volume-f17157e5-4545-4da0-b88a-3df9153b840a', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc5432d-7eea-45ae-8282-0c26daaadb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc5432d-7eea-45ae-8282-0c26daaadb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:56 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7a3afb7-9cf7-4dd7-a925-f7a710859e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:56 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] Volume f17157e5-4545-4da0-b88a-3df9153b840a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f17157e5-4545-4da0-b88a-3df9153b840a', 'volume_size': 1} Sep 05 11:48:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-585962260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f17157e5-4545-4da0-b88a-3df9153b840a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e177582856347edb9e4576d8fa2ba7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:48:57Z,use_quota=True,user_id='7e41de3a69af40c3b964de5b8e843048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:48:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] Creating volume f17157e5-4545-4da0-b88a-3df9153b840a {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:48:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:48:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:48:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:48:56 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:48:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f17157e5-4545-4da0-b88a-3df9153b840a 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:56 devstack sudo[103913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f17157e5-4545-4da0-b88a-3df9153b840a 1073741824 Sep 05 11:48:56 devstack sudo[103913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:56 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] Flow 'volume_create_manager' (570a92f9-f20f-4bb6-b280-1c911a9c0658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (971246f9-0f15-4338-ac48-06402fdc4c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (971246f9-0f15-4338-ac48-06402fdc4c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-776290780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e53e6c7-3f3f-43ef-a0eb-e427d263e08c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e177582856347edb9e4576d8fa2ba7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:48:57Z,use_quota=True,user_id='7e41de3a69af40c3b964de5b8e843048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba320db3-260a-433b-8bc7-6488960cfc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba320db3-260a-433b-8bc7-6488960cfc2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ba9ad52-8a56-4b4f-b881-a44690f68920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ba9ad52-8a56-4b4f-b881-a44690f68920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e53e6c7-3f3f-43ef-a0eb-e427d263e08c', 'volume_name': 'volume-4e53e6c7-3f3f-43ef-a0eb-e427d263e08c', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a8b4bb8-fd7b-4293-a77d-675fdd267baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a8b4bb8-fd7b-4293-a77d-675fdd267baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c46194-ec15-49cb-bd8b-10fc5c84657b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:57 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] Volume 4e53e6c7-3f3f-43ef-a0eb-e427d263e08c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e53e6c7-3f3f-43ef-a0eb-e427d263e08c', 'volume_size': 1} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:57 devstack sudo[103913]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f17157e5-4545-4da0-b88a-3df9153b840a 1073741824" returned: 0 in 0.689s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=71,cinder:UPDATE=105,cinder:INSERT=24,cinder:DELETE=7 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=90,cinder:UPDATE=103,cinder:INSERT=24,cinder:DELETE=10 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f17157e5-4545-4da0-b88a-3df9153b840a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:57 devstack sudo[103919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f17157e5-4545-4da0-b88a-3df9153b840a Sep 05 11:48:57 devstack sudo[103919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] Flow 'volume_create_manager' (e3173e22-2457-4a98-af8c-d6bfe8f892cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb900df7-d14b-4129-a5ec-8c37f924530f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb900df7-d14b-4129-a5ec-8c37f924530f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-42458182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d174596f-6afb-42b2-a23d-f9d517885955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e177582856347edb9e4576d8fa2ba7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:48:58Z,use_quota=True,user_id='7e41de3a69af40c3b964de5b8e843048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d662a24-5ae1-4f5c-be30-006048ad5d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d662a24-5ae1-4f5c-be30-006048ad5d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (089bd211-534e-4b9d-a3bb-bbab77e2fd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (089bd211-534e-4b9d-a3bb-bbab77e2fd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd174596f-6afb-42b2-a23d-f9d517885955', 'volume_name': 'volume-d174596f-6afb-42b2-a23d-f9d517885955', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b72dd9-d957-4178-91df-57d33c26ca08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b72dd9-d957-4178-91df-57d33c26ca08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc216f3c-f190-42cb-9165-9d17f80a2317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:57 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] Volume d174596f-6afb-42b2-a23d-f9d517885955: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d174596f-6afb-42b2-a23d-f9d517885955', 'volume_size': 1} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:57 devstack sudo[103919]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f17157e5-4545-4da0-b88a-3df9153b840a" returned: 0 in 0.303s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.673s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-776290780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e53e6c7-3f3f-43ef-a0eb-e427d263e08c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e177582856347edb9e4576d8fa2ba7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:48:57Z,use_quota=True,user_id='7e41de3a69af40c3b964de5b8e843048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] Creating volume 4e53e6c7-3f3f-43ef-a0eb-e427d263e08c {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:48:57 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4e53e6c7-3f3f-43ef-a0eb-e427d263e08c 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:57 devstack sudo[103922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4e53e6c7-3f3f-43ef-a0eb-e427d263e08c 1073741824 Sep 05 11:48:57 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7a3afb7-9cf7-4dd7-a925-f7a710859e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f17157e5-4545-4da0-b88a-3df9153b840a', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2b7c0ea-383e-444a-87f7-1ce8e171b07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:57 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] Volume volume-f17157e5-4545-4da0-b88a-3df9153b840a (f17157e5-4545-4da0-b88a-3df9153b840a): created successfully Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2b7c0ea-383e-444a-87f7-1ce8e171b07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] Flow 'volume_create_manager' (7e0ea1bb-b47c-45cd-86ea-0948b7b69a19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:48:57 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-0feefb93-afb6-4fbc-a951-46741d378b2b tempest-CreateVolumesFromSnapshotTest-920295763 None] Created volume successfully. Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] Flow 'volume_create_manager' (e293661f-335d-4791-a1eb-2092bd8b05f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27320a35-6020-473e-80e8-ddb966dc6eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27320a35-6020-473e-80e8-ddb966dc6eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-672434820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b2dbdd-1fcc-4053-bcc5-a8e888a630d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e177582856347edb9e4576d8fa2ba7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:48:58Z,use_quota=True,user_id='7e41de3a69af40c3b964de5b8e843048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5319b387-62c3-4dfd-86d0-7808a8f8e3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5319b387-62c3-4dfd-86d0-7808a8f8e3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6c15aa3-d52c-490d-912f-19cbe09e3da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6c15aa3-d52c-490d-912f-19cbe09e3da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7b2dbdd-1fcc-4053-bcc5-a8e888a630d8', 'volume_name': 'volume-c7b2dbdd-1fcc-4053-bcc5-a8e888a630d8', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8efedf65-4b36-4de9-ae68-d5b1578359ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8efedf65-4b36-4de9-ae68-d5b1578359ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba845f0-f3f6-4d83-aed9-07b52efc4f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:58 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] Volume c7b2dbdd-1fcc-4053-bcc5-a8e888a630d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7b2dbdd-1fcc-4053-bcc5-a8e888a630d8', 'volume_size': 1} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:58 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4e53e6c7-3f3f-43ef-a0eb-e427d263e08c 1073741824" returned: 0 in 0.587s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4e53e6c7-3f3f-43ef-a0eb-e427d263e08c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:58 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4e53e6c7-3f3f-43ef-a0eb-e427d263e08c Sep 05 11:48:58 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] Flow 'volume_create_manager' (4c4d8f26-55d7-451f-9274-2b79e8706296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (532a4f0f-adec-43fc-8859-9b9f05813225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (532a4f0f-adec-43fc-8859-9b9f05813225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1198780486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acbdaf46-9115-490f-a0a4-2d7904050efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e177582856347edb9e4576d8fa2ba7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:48:59Z,use_quota=True,user_id='7e41de3a69af40c3b964de5b8e843048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea54395e-84e7-4d1a-a244-8112133d4112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea54395e-84e7-4d1a-a244-8112133d4112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c9fbba-a287-4f38-bc9a-9685e86c32e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c9fbba-a287-4f38-bc9a-9685e86c32e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acbdaf46-9115-490f-a0a4-2d7904050efe', 'volume_name': 'volume-acbdaf46-9115-490f-a0a4-2d7904050efe', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b7a69d-6265-4ead-b021-06825f2046f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b7a69d-6265-4ead-b021-06825f2046f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dc69766-3ee5-4881-b169-1a4dde66d7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:58 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] Volume acbdaf46-9115-490f-a0a4-2d7904050efe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acbdaf46-9115-490f-a0a4-2d7904050efe', 'volume_size': 1} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:58 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4e53e6c7-3f3f-43ef-a0eb-e427d263e08c" returned: 0 in 0.394s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.116s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-42458182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d174596f-6afb-42b2-a23d-f9d517885955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e177582856347edb9e4576d8fa2ba7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:48:58Z,use_quota=True,user_id='7e41de3a69af40c3b964de5b8e843048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] Creating volume d174596f-6afb-42b2-a23d-f9d517885955 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:48:58 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d174596f-6afb-42b2-a23d-f9d517885955 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:58 devstack sudo[103933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d174596f-6afb-42b2-a23d-f9d517885955 1073741824 Sep 05 11:48:58 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c46194-ec15-49cb-bd8b-10fc5c84657b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e53e6c7-3f3f-43ef-a0eb-e427d263e08c', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958860c6-37e7-4cf1-ab42-42a021fa43a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:58 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] Volume volume-4e53e6c7-3f3f-43ef-a0eb-e427d263e08c (4e53e6c7-3f3f-43ef-a0eb-e427d263e08c): created successfully Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958860c6-37e7-4cf1-ab42-42a021fa43a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] Flow 'volume_create_manager' (570a92f9-f20f-4bb6-b280-1c911a9c0658) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:48:58 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-4c15a9ab-83a4-40ce-ab10-f8d49a6fa3dd tempest-CreateVolumesFromSnapshotTest-920295763 None] Created volume successfully. Sep 05 11:48:59 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d174596f-6afb-42b2-a23d-f9d517885955 1073741824" returned: 0 in 0.527s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d174596f-6afb-42b2-a23d-f9d517885955 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:59 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d174596f-6afb-42b2-a23d-f9d517885955 Sep 05 11:48:59 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:59 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Sep 05 11:48:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d174596f-6afb-42b2-a23d-f9d517885955" returned: 0 in 0.308s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:48:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:48:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.526s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-672434820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b2dbdd-1fcc-4053-bcc5-a8e888a630d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e177582856347edb9e4576d8fa2ba7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:48:58Z,use_quota=True,user_id='7e41de3a69af40c3b964de5b8e843048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:48:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] Creating volume c7b2dbdd-1fcc-4053-bcc5-a8e888a630d8 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:48:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:48:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:48:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:48:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:48:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:48:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:48:59 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:48:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c7b2dbdd-1fcc-4053-bcc5-a8e888a630d8 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:48:59 devstack sudo[103942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c7b2dbdd-1fcc-4053-bcc5-a8e888a630d8 1073741824 Sep 05 11:48:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc216f3c-f190-42cb-9165-9d17f80a2317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d174596f-6afb-42b2-a23d-f9d517885955', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:59 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:48:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e103901f-0ee1-4453-97c4-a294d9664286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:48:59 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] Volume volume-d174596f-6afb-42b2-a23d-f9d517885955 (d174596f-6afb-42b2-a23d-f9d517885955): created successfully Sep 05 11:48:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e103901f-0ee1-4453-97c4-a294d9664286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:48:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] Flow 'volume_create_manager' (e3173e22-2457-4a98-af8c-d6bfe8f892cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:48:59 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ed53b162-11e3-48e1-b49b-eec5aa3475cf tempest-CreateVolumesFromSnapshotTest-920295763 None] Created volume successfully. Sep 05 11:49:00 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c7b2dbdd-1fcc-4053-bcc5-a8e888a630d8 1073741824" returned: 0 in 0.489s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c7b2dbdd-1fcc-4053-bcc5-a8e888a630d8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:00 devstack sudo[103948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c7b2dbdd-1fcc-4053-bcc5-a8e888a630d8 Sep 05 11:49:00 devstack sudo[103948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:00 devstack sudo[103948]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c7b2dbdd-1fcc-4053-bcc5-a8e888a630d8" returned: 0 in 0.265s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:49:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.753s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1198780486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acbdaf46-9115-490f-a0a4-2d7904050efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e177582856347edb9e4576d8fa2ba7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:48:59Z,use_quota=True,user_id='7e41de3a69af40c3b964de5b8e843048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:49:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] Creating volume acbdaf46-9115-490f-a0a4-2d7904050efe {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:49:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:49:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:49:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:49:00 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:49:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-acbdaf46-9115-490f-a0a4-2d7904050efe 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:00 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba845f0-f3f6-4d83-aed9-07b52efc4f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7b2dbdd-1fcc-4053-bcc5-a8e888a630d8', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:00 devstack sudo[103951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-acbdaf46-9115-490f-a0a4-2d7904050efe 1073741824 Sep 05 11:49:00 devstack sudo[103951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:00 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f05d649a-be35-401b-bfb8-fdc2deb01a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:00 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] Volume volume-c7b2dbdd-1fcc-4053-bcc5-a8e888a630d8 (c7b2dbdd-1fcc-4053-bcc5-a8e888a630d8): created successfully Sep 05 11:49:00 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f05d649a-be35-401b-bfb8-fdc2deb01a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:00 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] Flow 'volume_create_manager' (e293661f-335d-4791-a1eb-2092bd8b05f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:49:00 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-0c2defbd-0936-42d3-8354-301d96379191 tempest-CreateVolumesFromSnapshotTest-920295763 None] Created volume successfully. Sep 05 11:49:01 devstack sudo[103951]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-acbdaf46-9115-490f-a0a4-2d7904050efe 1073741824" returned: 0 in 0.498s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-acbdaf46-9115-490f-a0a4-2d7904050efe {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:01 devstack sudo[103957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-acbdaf46-9115-490f-a0a4-2d7904050efe Sep 05 11:49:01 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:01 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-acbdaf46-9115-490f-a0a4-2d7904050efe" returned: 0 in 0.256s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:49:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dc69766-3ee5-4881-b169-1a4dde66d7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acbdaf46-9115-490f-a0a4-2d7904050efe', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f18497ad-fb62-4b5e-8494-0bf79fce2311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:01 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] Volume volume-acbdaf46-9115-490f-a0a4-2d7904050efe (acbdaf46-9115-490f-a0a4-2d7904050efe): created successfully Sep 05 11:49:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f18497ad-fb62-4b5e-8494-0bf79fce2311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] Flow 'volume_create_manager' (4c4d8f26-55d7-451f-9274-2b79e8706296) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:49:01 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-26089e42-3d2e-421f-a87e-6b2ff1c3f811 tempest-CreateVolumesFromSnapshotTest-920295763 None] Created volume successfully. Sep 05 11:49:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-48a1b1ce-29f8-4460-9f59-fd4038e1d28b tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "cinder-acbdaf46-9115-490f-a0a4-2d7904050efe-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-48a1b1ce-29f8-4460-9f59-fd4038e1d28b tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "cinder-acbdaf46-9115-490f-a0a4-2d7904050efe-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-48a1b1ce-29f8-4460-9f59-fd4038e1d28b tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "cinder-quobyte-acbdaf46-9115-490f-a0a4-2d7904050efe" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-48a1b1ce-29f8-4460-9f59-fd4038e1d28b tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "cinder-quobyte-acbdaf46-9115-490f-a0a4-2d7904050efe" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:02 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45e3642-876f-4036-bb73-7a5cde3ead9f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-48a1b1ce-29f8-4460-9f59-fd4038e1d28b tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-acbdaf46-9115-490f-a0a4-2d7904050efe {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:02 devstack sudo[103961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-acbdaf46-9115-490f-a0a4-2d7904050efe Sep 05 11:49:02 devstack sudo[103961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:02 devstack sudo[103961]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-48a1b1ce-29f8-4460-9f59-fd4038e1d28b tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-acbdaf46-9115-490f-a0a4-2d7904050efe" returned: 0 in 0.384s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-48a1b1ce-29f8-4460-9f59-fd4038e1d28b tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-acbdaf46-9115-490f-a0a4-2d7904050efe {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:02 devstack sudo[103967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-acbdaf46-9115-490f-a0a4-2d7904050efe Sep 05 11:49:02 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:02 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-48a1b1ce-29f8-4460-9f59-fd4038e1d28b tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-acbdaf46-9115-490f-a0a4-2d7904050efe" returned: 0 in 0.248s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-48a1b1ce-29f8-4460-9f59-fd4038e1d28b tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "cinder-quobyte-acbdaf46-9115-490f-a0a4-2d7904050efe" released by "delete_volume" :: held 0.674s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-48a1b1ce-29f8-4460-9f59-fd4038e1d28b tempest-CreateVolumesFromSnapshotTest-920295763 None] Created reservations ['d95fa6ca-0a0c-4c0d-87a7-bf9a8df1c239', 'ad54c6f4-cc70-4849-a8ab-c6fd6445aaa3', '95655d97-c249-42d7-a90b-9e591c2f9e2d', 'f738b801-9552-421e-8dfd-9033f37bd429'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-48a1b1ce-29f8-4460-9f59-fd4038e1d28b tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-48a1b1ce-29f8-4460-9f59-fd4038e1d28b tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-48a1b1ce-29f8-4460-9f59-fd4038e1d28b tempest-CreateVolumesFromSnapshotTest-920295763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-48a1b1ce-29f8-4460-9f59-fd4038e1d28b tempest-CreateVolumesFromSnapshotTest-920295763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-48a1b1ce-29f8-4460-9f59-fd4038e1d28b tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-48a1b1ce-29f8-4460-9f59-fd4038e1d28b tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:03 devstack sudo[103970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:49:03 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:03 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-48a1b1ce-29f8-4460-9f59-fd4038e1d28b tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.274s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-48a1b1ce-29f8-4460-9f59-fd4038e1d28b tempest-CreateVolumesFromSnapshotTest-920295763 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:49:03 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-48a1b1ce-29f8-4460-9f59-fd4038e1d28b tempest-CreateVolumesFromSnapshotTest-920295763 None] Deleted volume successfully. Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-48a1b1ce-29f8-4460-9f59-fd4038e1d28b tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "cinder-acbdaf46-9115-490f-a0a4-2d7904050efe-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-beaa20a8-3413-4dca-8756-06e49cf9031b tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "cinder-c7b2dbdd-1fcc-4053-bcc5-a8e888a630d8-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-beaa20a8-3413-4dca-8756-06e49cf9031b tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "cinder-c7b2dbdd-1fcc-4053-bcc5-a8e888a630d8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-beaa20a8-3413-4dca-8756-06e49cf9031b tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "cinder-quobyte-c7b2dbdd-1fcc-4053-bcc5-a8e888a630d8" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] Flow 'volume_create_manager' (61cf9eda-f109-4bf4-979e-f8f196b387c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe78f31-9604-4e6d-b0a0-82da167c7179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-beaa20a8-3413-4dca-8756-06e49cf9031b tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "cinder-quobyte-c7b2dbdd-1fcc-4053-bcc5-a8e888a630d8" acquired by "delete_volume" :: waited 0.053s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d508e8c-4bd4-4f2f-a0b6-8896ea530922]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-beaa20a8-3413-4dca-8756-06e49cf9031b tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c7b2dbdd-1fcc-4053-bcc5-a8e888a630d8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe78f31-9604-4e6d-b0a0-82da167c7179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1469906639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0433c512-be81-4662-bea7-0bdf53d83108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f556617c7c64576aa8eed133e849c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:49:03Z,use_quota=True,user_id='d04de16868fc45639cf91eed5d3aefea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f2b9e6f-adbb-4b04-92f1-bc29ecbc78d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f2b9e6f-adbb-4b04-92f1-bc29ecbc78d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de201ea-86ae-44ab-be62-df94a62c9a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de201ea-86ae-44ab-be62-df94a62c9a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0433c512-be81-4662-bea7-0bdf53d83108', 'volume_name': 'volume-0433c512-be81-4662-bea7-0bdf53d83108', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b7dc95-4ac6-485b-aa60-938c5e56099f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b7dc95-4ac6-485b-aa60-938c5e56099f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ef81515-62da-4fe9-845b-fd583c237318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:03 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] Volume 0433c512-be81-4662-bea7-0bdf53d83108: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0433c512-be81-4662-bea7-0bdf53d83108', 'volume_size': 1} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1469906639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0433c512-be81-4662-bea7-0bdf53d83108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f556617c7c64576aa8eed133e849c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:49:03Z,use_quota=True,user_id='d04de16868fc45639cf91eed5d3aefea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] Creating volume 0433c512-be81-4662-bea7-0bdf53d83108 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:49:03 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:03 devstack sudo[103974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108 1073741824 Sep 05 11:49:03 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:03 devstack sudo[103973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c7b2dbdd-1fcc-4053-bcc5-a8e888a630d8 Sep 05 11:49:03 devstack sudo[103973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:03 devstack sudo[103973]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-beaa20a8-3413-4dca-8756-06e49cf9031b tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c7b2dbdd-1fcc-4053-bcc5-a8e888a630d8" returned: 0 in 0.364s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-beaa20a8-3413-4dca-8756-06e49cf9031b tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c7b2dbdd-1fcc-4053-bcc5-a8e888a630d8 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:03 devstack sudo[103983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c7b2dbdd-1fcc-4053-bcc5-a8e888a630d8 Sep 05 11:49:03 devstack sudo[103983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:04 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108 1073741824" returned: 0 in 0.452s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:04 devstack sudo[103987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108 Sep 05 11:49:04 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:04 devstack sudo[103983]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-beaa20a8-3413-4dca-8756-06e49cf9031b tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c7b2dbdd-1fcc-4053-bcc5-a8e888a630d8" returned: 0 in 0.274s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:04 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-beaa20a8-3413-4dca-8756-06e49cf9031b tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "cinder-quobyte-c7b2dbdd-1fcc-4053-bcc5-a8e888a630d8" released by "delete_volume" :: held 0.690s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:04 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-beaa20a8-3413-4dca-8756-06e49cf9031b tempest-CreateVolumesFromSnapshotTest-920295763 None] Created reservations ['0f10b9f7-4d78-4429-be88-00d86f3bdd45', 'badd1164-63d7-4071-8352-6d0b1921e9db', '63125315-755f-457a-b5bd-071692c7b178', 'cbed2852-9216-4fdf-9a41-32ea9d423e1b'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:49:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-beaa20a8-3413-4dca-8756-06e49cf9031b tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-beaa20a8-3413-4dca-8756-06e49cf9031b tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-beaa20a8-3413-4dca-8756-06e49cf9031b tempest-CreateVolumesFromSnapshotTest-920295763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:49:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-beaa20a8-3413-4dca-8756-06e49cf9031b tempest-CreateVolumesFromSnapshotTest-920295763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:49:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-beaa20a8-3413-4dca-8756-06e49cf9031b tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-beaa20a8-3413-4dca-8756-06e49cf9031b tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:04 devstack sudo[103989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:49:04 devstack sudo[103989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:04 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108" returned: 0 in 0.254s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:49:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ef81515-62da-4fe9-845b-fd583c237318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0433c512-be81-4662-bea7-0bdf53d83108', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c0c6532-51fb-4399-82ea-d10804b509fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:04 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] Volume volume-0433c512-be81-4662-bea7-0bdf53d83108 (0433c512-be81-4662-bea7-0bdf53d83108): created successfully Sep 05 11:49:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c0c6532-51fb-4399-82ea-d10804b509fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] Flow 'volume_create_manager' (61cf9eda-f109-4bf4-979e-f8f196b387c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:49:04 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-41a8a009-1ac7-4345-afc6-464020c0314b tempest-VolumesSnapshotTestJSON-1655972575 None] Created volume successfully. Sep 05 11:49:04 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c314b368-8060-4daf-98a9-fc8dcb8cd4c7 tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "cinder-d174596f-6afb-42b2-a23d-f9d517885955-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:04 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c314b368-8060-4daf-98a9-fc8dcb8cd4c7 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "cinder-d174596f-6afb-42b2-a23d-f9d517885955-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:04 devstack sudo[103989]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-beaa20a8-3413-4dca-8756-06e49cf9031b tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.281s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:04 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-beaa20a8-3413-4dca-8756-06e49cf9031b tempest-CreateVolumesFromSnapshotTest-920295763 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:49:04 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c314b368-8060-4daf-98a9-fc8dcb8cd4c7 tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "cinder-quobyte-d174596f-6afb-42b2-a23d-f9d517885955" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:04 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-beaa20a8-3413-4dca-8756-06e49cf9031b tempest-CreateVolumesFromSnapshotTest-920295763 None] Deleted volume successfully. Sep 05 11:49:04 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c314b368-8060-4daf-98a9-fc8dcb8cd4c7 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "cinder-quobyte-d174596f-6afb-42b2-a23d-f9d517885955" acquired by "delete_volume" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:04 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-beaa20a8-3413-4dca-8756-06e49cf9031b tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "cinder-c7b2dbdd-1fcc-4053-bcc5-a8e888a630d8-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:04 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3329afc-ff29-4465-a594-ec66a4e2cbf8]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c314b368-8060-4daf-98a9-fc8dcb8cd4c7 tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d174596f-6afb-42b2-a23d-f9d517885955 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:04 devstack sudo[103993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d174596f-6afb-42b2-a23d-f9d517885955 Sep 05 11:49:04 devstack sudo[103993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:05 devstack sudo[103993]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c314b368-8060-4daf-98a9-fc8dcb8cd4c7 tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d174596f-6afb-42b2-a23d-f9d517885955" returned: 0 in 0.344s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c314b368-8060-4daf-98a9-fc8dcb8cd4c7 tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d174596f-6afb-42b2-a23d-f9d517885955 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:05 devstack sudo[103998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d174596f-6afb-42b2-a23d-f9d517885955 Sep 05 11:49:05 devstack sudo[103998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:05 devstack sudo[103998]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c314b368-8060-4daf-98a9-fc8dcb8cd4c7 tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d174596f-6afb-42b2-a23d-f9d517885955" returned: 0 in 0.233s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c314b368-8060-4daf-98a9-fc8dcb8cd4c7 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "cinder-quobyte-d174596f-6afb-42b2-a23d-f9d517885955" released by "delete_volume" :: held 0.624s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:05 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-c314b368-8060-4daf-98a9-fc8dcb8cd4c7 tempest-CreateVolumesFromSnapshotTest-920295763 None] Created reservations ['8888b008-2bb4-4da5-94dd-e078d0ea721a', 'a4c3259a-a525-4f1c-9a28-6c3b6606961e', '540b4dee-f708-4775-b532-076fac4179e0', 'c7660830-5c61-4a59-9d0b-02c1f07b313f'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:49:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c314b368-8060-4daf-98a9-fc8dcb8cd4c7 tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c314b368-8060-4daf-98a9-fc8dcb8cd4c7 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c314b368-8060-4daf-98a9-fc8dcb8cd4c7 tempest-CreateVolumesFromSnapshotTest-920295763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:49:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c314b368-8060-4daf-98a9-fc8dcb8cd4c7 tempest-CreateVolumesFromSnapshotTest-920295763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:49:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c314b368-8060-4daf-98a9-fc8dcb8cd4c7 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c314b368-8060-4daf-98a9-fc8dcb8cd4c7 tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:05 devstack sudo[104001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:49:05 devstack sudo[104001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:05 devstack sudo[104001]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c314b368-8060-4daf-98a9-fc8dcb8cd4c7 tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.246s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:05 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-c314b368-8060-4daf-98a9-fc8dcb8cd4c7 tempest-CreateVolumesFromSnapshotTest-920295763 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:49:05 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c314b368-8060-4daf-98a9-fc8dcb8cd4c7 tempest-CreateVolumesFromSnapshotTest-920295763 None] Deleted volume successfully. Sep 05 11:49:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c314b368-8060-4daf-98a9-fc8dcb8cd4c7 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "cinder-d174596f-6afb-42b2-a23d-f9d517885955-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d3a76249-13d9-49b1-9d90-aee020e3ff02 tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "cinder-4e53e6c7-3f3f-43ef-a0eb-e427d263e08c-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d3a76249-13d9-49b1-9d90-aee020e3ff02 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "cinder-4e53e6c7-3f3f-43ef-a0eb-e427d263e08c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d3a76249-13d9-49b1-9d90-aee020e3ff02 tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "cinder-quobyte-4e53e6c7-3f3f-43ef-a0eb-e427d263e08c" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d3a76249-13d9-49b1-9d90-aee020e3ff02 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "cinder-quobyte-4e53e6c7-3f3f-43ef-a0eb-e427d263e08c" acquired by "delete_volume" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:05 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0510ea-6226-4803-b729-6a28dc21bf1d]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d3a76249-13d9-49b1-9d90-aee020e3ff02 tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4e53e6c7-3f3f-43ef-a0eb-e427d263e08c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:05 devstack sudo[104004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4e53e6c7-3f3f-43ef-a0eb-e427d263e08c Sep 05 11:49:05 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-52512c2c-a54b-4191-be71-1c05706179e9 tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-52512c2c-a54b-4191-be71-1c05706179e9 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-52512c2c-a54b-4191-be71-1c05706179e9 tempest-VolumesSnapshotTestJSON-1655972575 None] Creating offline snapshot d0e35a5f-c5a1-4e8d-b880-8d42dd969950 of volume 0433c512-be81-4662-bea7-0bdf53d83108 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:49:06 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c89e86e-ba13-4ad9-98ba-b7e27e5f830f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-52512c2c-a54b-4191-be71-1c05706179e9 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:06 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d3a76249-13d9-49b1-9d90-aee020e3ff02 tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4e53e6c7-3f3f-43ef-a0eb-e427d263e08c" returned: 0 in 0.383s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d3a76249-13d9-49b1-9d90-aee020e3ff02 tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4e53e6c7-3f3f-43ef-a0eb-e427d263e08c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:06 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4e53e6c7-3f3f-43ef-a0eb-e427d263e08c Sep 05 11:49:06 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:06 devstack sudo[104009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108 Sep 05 11:49:06 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:06 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d3a76249-13d9-49b1-9d90-aee020e3ff02 tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4e53e6c7-3f3f-43ef-a0eb-e427d263e08c" returned: 0 in 0.241s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d3a76249-13d9-49b1-9d90-aee020e3ff02 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "cinder-quobyte-4e53e6c7-3f3f-43ef-a0eb-e427d263e08c" released by "delete_volume" :: held 0.669s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:06 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:06 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-d3a76249-13d9-49b1-9d90-aee020e3ff02 tempest-CreateVolumesFromSnapshotTest-920295763 None] Created reservations ['17d4cb62-508f-4da6-ad29-b7956105d852', '92de6155-83a1-4238-a55b-2043136ec639', '0299ae5c-109b-4bb6-92db-feb7de7a2d11', '90b96da5-66ed-44bd-a9bf-2b5d5366991a'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:49:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-52512c2c-a54b-4191-be71-1c05706179e9 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108" returned: 0 in 0.362s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-52512c2c-a54b-4191-be71-1c05706179e9 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108.d0e35a5f-c5a1-4e8d-b880-8d42dd969950 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:06 devstack sudo[104017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108.d0e35a5f-c5a1-4e8d-b880-8d42dd969950 1G Sep 05 11:49:06 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d3a76249-13d9-49b1-9d90-aee020e3ff02 tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d3a76249-13d9-49b1-9d90-aee020e3ff02 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d3a76249-13d9-49b1-9d90-aee020e3ff02 tempest-CreateVolumesFromSnapshotTest-920295763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:49:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d3a76249-13d9-49b1-9d90-aee020e3ff02 tempest-CreateVolumesFromSnapshotTest-920295763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:49:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d3a76249-13d9-49b1-9d90-aee020e3ff02 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d3a76249-13d9-49b1-9d90-aee020e3ff02 tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:06 devstack sudo[104019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:49:06 devstack sudo[104019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:06 devstack sudo[104019]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d3a76249-13d9-49b1-9d90-aee020e3ff02 tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.273s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:06 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-d3a76249-13d9-49b1-9d90-aee020e3ff02 tempest-CreateVolumesFromSnapshotTest-920295763 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:49:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1cca1c7d-887f-4792-ba24-0f304809a384 tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "cinder-f17157e5-4545-4da0-b88a-3df9153b840a-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:06 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d3a76249-13d9-49b1-9d90-aee020e3ff02 tempest-CreateVolumesFromSnapshotTest-920295763 None] Deleted volume successfully. Sep 05 11:49:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1cca1c7d-887f-4792-ba24-0f304809a384 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "cinder-f17157e5-4545-4da0-b88a-3df9153b840a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d3a76249-13d9-49b1-9d90-aee020e3ff02 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "cinder-4e53e6c7-3f3f-43ef-a0eb-e427d263e08c-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1cca1c7d-887f-4792-ba24-0f304809a384 tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "cinder-quobyte-f17157e5-4545-4da0-b88a-3df9153b840a" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1cca1c7d-887f-4792-ba24-0f304809a384 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "cinder-quobyte-f17157e5-4545-4da0-b88a-3df9153b840a" acquired by "delete_volume" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:07 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-52512c2c-a54b-4191-be71-1c05706179e9 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108.d0e35a5f-c5a1-4e8d-b880-8d42dd969950 1G" returned: 0 in 0.477s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-52512c2c-a54b-4191-be71-1c05706179e9 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0433c512-be81-4662-bea7-0bdf53d83108 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108.d0e35a5f-c5a1-4e8d-b880-8d42dd969950 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:07 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce843eb8-dc31-46dd-9afc-1ddb90ca7f20]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1cca1c7d-887f-4792-ba24-0f304809a384 tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f17157e5-4545-4da0-b88a-3df9153b840a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:07 devstack sudo[104026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0433c512-be81-4662-bea7-0bdf53d83108 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108.d0e35a5f-c5a1-4e8d-b880-8d42dd969950 Sep 05 11:49:07 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:07 devstack sudo[104027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f17157e5-4545-4da0-b88a-3df9153b840a Sep 05 11:49:07 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:07 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-52512c2c-a54b-4191-be71-1c05706179e9 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0433c512-be81-4662-bea7-0bdf53d83108 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108.d0e35a5f-c5a1-4e8d-b880-8d42dd969950" returned: 0 in 0.292s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:07 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-52512c2c-a54b-4191-be71-1c05706179e9 tempest-VolumesSnapshotTestJSON-1655972575 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108.d0e35a5f-c5a1-4e8d-b880-8d42dd969950 is being set with open permissions: ugo+rw Sep 05 11:49:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-52512c2c-a54b-4191-be71-1c05706179e9 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108.d0e35a5f-c5a1-4e8d-b880-8d42dd969950 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:07 devstack sudo[104033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108.d0e35a5f-c5a1-4e8d-b880-8d42dd969950 Sep 05 11:49:07 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:07 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1cca1c7d-887f-4792-ba24-0f304809a384 tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f17157e5-4545-4da0-b88a-3df9153b840a" returned: 0 in 0.378s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1cca1c7d-887f-4792-ba24-0f304809a384 tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f17157e5-4545-4da0-b88a-3df9153b840a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:07 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f17157e5-4545-4da0-b88a-3df9153b840a Sep 05 11:49:07 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:07 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-52512c2c-a54b-4191-be71-1c05706179e9 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108.d0e35a5f-c5a1-4e8d-b880-8d42dd969950" returned: 0 in 0.240s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-52512c2c-a54b-4191-be71-1c05706179e9 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:07 devstack sudo[104041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108.info Sep 05 11:49:07 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:07 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1cca1c7d-887f-4792-ba24-0f304809a384 tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-f17157e5-4545-4da0-b88a-3df9153b840a" returned: 0 in 0.247s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1cca1c7d-887f-4792-ba24-0f304809a384 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "cinder-quobyte-f17157e5-4545-4da0-b88a-3df9153b840a" released by "delete_volume" :: held 0.672s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:07 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-1cca1c7d-887f-4792-ba24-0f304809a384 tempest-CreateVolumesFromSnapshotTest-920295763 None] Created reservations ['18f98eb1-4200-401c-b590-1b2ab450c579', 'ea5faa6c-7dcb-4a1b-ab9d-f6f9c128946a', 'f81cdb04-6f44-4de8-b9e8-fa4d9b85b482', '7c4f8b95-7b66-43f8-965c-3244c34fe4b2'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:49:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1cca1c7d-887f-4792-ba24-0f304809a384 tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1cca1c7d-887f-4792-ba24-0f304809a384 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1cca1c7d-887f-4792-ba24-0f304809a384 tempest-CreateVolumesFromSnapshotTest-920295763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:49:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1cca1c7d-887f-4792-ba24-0f304809a384 tempest-CreateVolumesFromSnapshotTest-920295763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:49:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1cca1c7d-887f-4792-ba24-0f304809a384 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1cca1c7d-887f-4792-ba24-0f304809a384 tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:07 devstack sudo[104044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:49:07 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:07 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-52512c2c-a54b-4191-be71-1c05706179e9 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108.info" returned: 0 in 0.260s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:07 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-52512c2c-a54b-4191-be71-1c05706179e9 tempest-VolumesSnapshotTestJSON-1655972575 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108.info is being set with open permissions: ugo+rw Sep 05 11:49:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-52512c2c-a54b-4191-be71-1c05706179e9 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:07 devstack sudo[104047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108.info Sep 05 11:49:07 devstack sudo[104047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:08 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1cca1c7d-887f-4792-ba24-0f304809a384 tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.255s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:08 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-1cca1c7d-887f-4792-ba24-0f304809a384 tempest-CreateVolumesFromSnapshotTest-920295763 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:49:08 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-1cca1c7d-887f-4792-ba24-0f304809a384 tempest-CreateVolumesFromSnapshotTest-920295763 None] Deleted volume successfully. Sep 05 11:49:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1cca1c7d-887f-4792-ba24-0f304809a384 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "cinder-f17157e5-4545-4da0-b88a-3df9153b840a-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:08 devstack sudo[104047]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-316e042d-081b-4ee2-bed0-44afefa97b5d tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "cinder-a2b034eb-82f4-4270-894e-5566e3320956-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-52512c2c-a54b-4191-be71-1c05706179e9 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108.info" returned: 0 in 0.254s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-52512c2c-a54b-4191-be71-1c05706179e9 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.977s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-316e042d-081b-4ee2-bed0-44afefa97b5d tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "cinder-a2b034eb-82f4-4270-894e-5566e3320956-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-316e042d-081b-4ee2-bed0-44afefa97b5d tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "cinder-quobyte-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-316e042d-081b-4ee2-bed0-44afefa97b5d tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "cinder-quobyte-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-316e042d-081b-4ee2-bed0-44afefa97b5d tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "cinder-quobyte-a2b034eb-82f4-4270-894e-5566e3320956" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-316e042d-081b-4ee2-bed0-44afefa97b5d tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "cinder-quobyte-a2b034eb-82f4-4270-894e-5566e3320956" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-316e042d-081b-4ee2-bed0-44afefa97b5d tempest-CreateVolumesFromSnapshotTest-920295763 None] Deleting offline snapshot a2b034eb-82f4-4270-894e-5566e3320956 of volume ea71036b-9ae1-42b8-a2d5-8ffa830c24c9 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:49:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-316e042d-081b-4ee2-bed0-44afefa97b5d tempest-CreateVolumesFromSnapshotTest-920295763 None] snapshot_file for this snap is: volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9.a2b034eb-82f4-4270-894e-5566e3320956 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:49:08 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a172c5ec-2658-43a5-81eb-6c0836d49085]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-316e042d-081b-4ee2-bed0-44afefa97b5d tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9.a2b034eb-82f4-4270-894e-5566e3320956 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:08 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-52512c2c-a54b-4191-be71-1c05706179e9 tempest-VolumesSnapshotTestJSON-1655972575 None] Create snapshot completed successfully Sep 05 11:49:08 devstack sudo[104051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9.a2b034eb-82f4-4270-894e-5566e3320956 Sep 05 11:49:08 devstack sudo[104051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:08 devstack sudo[104051]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-316e042d-081b-4ee2-bed0-44afefa97b5d tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9.a2b034eb-82f4-4270-894e-5566e3320956" returned: 0 in 0.352s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-316e042d-081b-4ee2-bed0-44afefa97b5d tempest-CreateVolumesFromSnapshotTest-920295763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:49:08 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa11640-7d11-499a-9ed7-0e309ee59553]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-316e042d-081b-4ee2-bed0-44afefa97b5d tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:08 devstack sudo[104056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9 Sep 05 11:49:08 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:08 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-316e042d-081b-4ee2-bed0-44afefa97b5d tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9" returned: 0 in 0.350s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-316e042d-081b-4ee2-bed0-44afefa97b5d tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9.a2b034eb-82f4-4270-894e-5566e3320956 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:08 devstack sudo[104061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9.a2b034eb-82f4-4270-894e-5566e3320956 Sep 05 11:49:08 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:09 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-316e042d-081b-4ee2-bed0-44afefa97b5d tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9.a2b034eb-82f4-4270-894e-5566e3320956" returned: 0 in 0.354s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-316e042d-081b-4ee2-bed0-44afefa97b5d tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9.a2b034eb-82f4-4270-894e-5566e3320956 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:09 devstack sudo[104067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9.a2b034eb-82f4-4270-894e-5566e3320956 Sep 05 11:49:09 devstack sudo[104067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-005e1265-3c3a-45ac-ab1f-3ee8cd4c0dc6 tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "cinder-d0e35a5f-c5a1-4e8d-b880-8d42dd969950-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-005e1265-3c3a-45ac-ab1f-3ee8cd4c0dc6 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-d0e35a5f-c5a1-4e8d-b880-8d42dd969950-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-005e1265-3c3a-45ac-ab1f-3ee8cd4c0dc6 tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "cinder-quobyte-0433c512-be81-4662-bea7-0bdf53d83108" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-005e1265-3c3a-45ac-ab1f-3ee8cd4c0dc6 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-quobyte-0433c512-be81-4662-bea7-0bdf53d83108" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-005e1265-3c3a-45ac-ab1f-3ee8cd4c0dc6 tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "cinder-quobyte-d0e35a5f-c5a1-4e8d-b880-8d42dd969950" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-005e1265-3c3a-45ac-ab1f-3ee8cd4c0dc6 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-quobyte-d0e35a5f-c5a1-4e8d-b880-8d42dd969950" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-005e1265-3c3a-45ac-ab1f-3ee8cd4c0dc6 tempest-VolumesSnapshotTestJSON-1655972575 None] Deleting offline snapshot d0e35a5f-c5a1-4e8d-b880-8d42dd969950 of volume 0433c512-be81-4662-bea7-0bdf53d83108 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:49:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-005e1265-3c3a-45ac-ab1f-3ee8cd4c0dc6 tempest-VolumesSnapshotTestJSON-1655972575 None] snapshot_file for this snap is: volume-0433c512-be81-4662-bea7-0bdf53d83108.d0e35a5f-c5a1-4e8d-b880-8d42dd969950 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:49:09 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b9835a-3fd7-4584-a2d5-9044391b5643]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-005e1265-3c3a-45ac-ab1f-3ee8cd4c0dc6 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108.d0e35a5f-c5a1-4e8d-b880-8d42dd969950 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:09 devstack sudo[104067]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-316e042d-081b-4ee2-bed0-44afefa97b5d tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9.a2b034eb-82f4-4270-894e-5566e3320956" returned: 0 in 0.271s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-316e042d-081b-4ee2-bed0-44afefa97b5d tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "cinder-quobyte-a2b034eb-82f4-4270-894e-5566e3320956" released by "_delete_snapshot" :: held 1.422s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-316e042d-081b-4ee2-bed0-44afefa97b5d tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "cinder-quobyte-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9" released by "delete_snapshot" :: held 1.447s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:09 devstack sudo[104070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108.d0e35a5f-c5a1-4e8d-b880-8d42dd969950 Sep 05 11:49:09 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:09 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-316e042d-081b-4ee2-bed0-44afefa97b5d tempest-CreateVolumesFromSnapshotTest-920295763 None] Created reservations ['3068705f-a766-4fdd-81bc-5f81c92f5418', 'ee8c0bd3-e28d-44eb-b225-a6e0d2bf568e', '51367a7a-c5f4-4544-8445-7e6e611dac1f', '9deb2f2a-7f49-4ba1-a25a-391540411b94'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:49:09 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-316e042d-081b-4ee2-bed0-44afefa97b5d tempest-CreateVolumesFromSnapshotTest-920295763 None] Delete snapshot completed successfully. Sep 05 11:49:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-316e042d-081b-4ee2-bed0-44afefa97b5d tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "cinder-a2b034eb-82f4-4270-894e-5566e3320956-delete_snapshot" released by "delete_snapshot" :: held 1.581s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:09 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-005e1265-3c3a-45ac-ab1f-3ee8cd4c0dc6 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108.d0e35a5f-c5a1-4e8d-b880-8d42dd969950" returned: 0 in 0.356s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-005e1265-3c3a-45ac-ab1f-3ee8cd4c0dc6 tempest-VolumesSnapshotTestJSON-1655972575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0433c512-be81-4662-bea7-0bdf53d83108(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:49:09 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed0aea6-8e27-449a-ae1a-9c1ed1769539]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-005e1265-3c3a-45ac-ab1f-3ee8cd4c0dc6 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:10 devstack sudo[104075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108 Sep 05 11:49:10 devstack sudo[104075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b16b2638-2fb0-4bd5-9620-6d2713061136 tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "cinder-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b16b2638-2fb0-4bd5-9620-6d2713061136 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "cinder-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:10 devstack sudo[104075]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-005e1265-3c3a-45ac-ab1f-3ee8cd4c0dc6 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108" returned: 0 in 0.363s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-005e1265-3c3a-45ac-ab1f-3ee8cd4c0dc6 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108.d0e35a5f-c5a1-4e8d-b880-8d42dd969950 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:10 devstack sudo[104080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108.d0e35a5f-c5a1-4e8d-b880-8d42dd969950 Sep 05 11:49:10 devstack sudo[104080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b16b2638-2fb0-4bd5-9620-6d2713061136 tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "cinder-quobyte-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b16b2638-2fb0-4bd5-9620-6d2713061136 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "cinder-quobyte-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9" acquired by "delete_volume" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:10 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fca4213-8454-4aa2-a807-95008f0ace39]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b16b2638-2fb0-4bd5-9620-6d2713061136 tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:10 devstack sudo[104082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9 Sep 05 11:49:10 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:10 devstack sudo[104080]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-005e1265-3c3a-45ac-ab1f-3ee8cd4c0dc6 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108.d0e35a5f-c5a1-4e8d-b880-8d42dd969950" returned: 0 in 0.341s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-005e1265-3c3a-45ac-ab1f-3ee8cd4c0dc6 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108.d0e35a5f-c5a1-4e8d-b880-8d42dd969950 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:10 devstack sudo[104087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108.d0e35a5f-c5a1-4e8d-b880-8d42dd969950 Sep 05 11:49:10 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:10 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b16b2638-2fb0-4bd5-9620-6d2713061136 tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9" returned: 0 in 0.377s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b16b2638-2fb0-4bd5-9620-6d2713061136 tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:10 devstack sudo[104092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9 Sep 05 11:49:10 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:10 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-005e1265-3c3a-45ac-ab1f-3ee8cd4c0dc6 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108.d0e35a5f-c5a1-4e8d-b880-8d42dd969950" returned: 0 in 0.254s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-005e1265-3c3a-45ac-ab1f-3ee8cd4c0dc6 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-quobyte-d0e35a5f-c5a1-4e8d-b880-8d42dd969950" released by "_delete_snapshot" :: held 1.409s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-005e1265-3c3a-45ac-ab1f-3ee8cd4c0dc6 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-quobyte-0433c512-be81-4662-bea7-0bdf53d83108" released by "delete_snapshot" :: held 1.430s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:11 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-005e1265-3c3a-45ac-ab1f-3ee8cd4c0dc6 tempest-VolumesSnapshotTestJSON-1655972575 None] Created reservations ['85a75e62-f153-4942-a599-816613cf26ac', '2301b6d1-d5cb-4491-9878-c6a235b61102', '6361290a-67ef-4cab-974e-0615a85f8063', 'e8ff8943-c689-4bf4-826b-95b275bb1516'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:49:11 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b16b2638-2fb0-4bd5-9620-6d2713061136 tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9" returned: 0 in 0.255s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b16b2638-2fb0-4bd5-9620-6d2713061136 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "cinder-quobyte-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9" released by "delete_volume" :: held 0.687s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:11 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-005e1265-3c3a-45ac-ab1f-3ee8cd4c0dc6 tempest-VolumesSnapshotTestJSON-1655972575 None] Delete snapshot completed successfully. Sep 05 11:49:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-005e1265-3c3a-45ac-ab1f-3ee8cd4c0dc6 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-d0e35a5f-c5a1-4e8d-b880-8d42dd969950-delete_snapshot" released by "delete_snapshot" :: held 1.632s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:11 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-b16b2638-2fb0-4bd5-9620-6d2713061136 tempest-CreateVolumesFromSnapshotTest-920295763 None] Created reservations ['507182ce-7c7d-4ddb-9b0c-e93705c06b12', '96af93be-3ca6-464f-bf42-17fa2e4fbaa4', '8c8024bb-59db-486f-bc5a-d013192574c5', 'd9cabc86-e695-47ba-be59-54082356ccaa'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:49:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b16b2638-2fb0-4bd5-9620-6d2713061136 tempest-CreateVolumesFromSnapshotTest-920295763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b16b2638-2fb0-4bd5-9620-6d2713061136 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b16b2638-2fb0-4bd5-9620-6d2713061136 tempest-CreateVolumesFromSnapshotTest-920295763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:49:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b16b2638-2fb0-4bd5-9620-6d2713061136 tempest-CreateVolumesFromSnapshotTest-920295763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:49:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b16b2638-2fb0-4bd5-9620-6d2713061136 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b16b2638-2fb0-4bd5-9620-6d2713061136 tempest-CreateVolumesFromSnapshotTest-920295763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:11 devstack sudo[104096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:49:11 devstack sudo[104096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:11 devstack sudo[104096]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b16b2638-2fb0-4bd5-9620-6d2713061136 tempest-CreateVolumesFromSnapshotTest-920295763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.243s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:11 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-b16b2638-2fb0-4bd5-9620-6d2713061136 tempest-CreateVolumesFromSnapshotTest-920295763 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:49:11 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b16b2638-2fb0-4bd5-9620-6d2713061136 tempest-CreateVolumesFromSnapshotTest-920295763 None] Deleted volume successfully. Sep 05 11:49:11 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b16b2638-2fb0-4bd5-9620-6d2713061136 tempest-CreateVolumesFromSnapshotTest-920295763 None] Lock "cinder-ea71036b-9ae1-42b8-a2d5-8ffa830c24c9-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:12 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:49:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] Flow 'volume_create_manager' (e53974dc-1022-4264-acbc-09468b774748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:49:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (289735dc-b6cd-404f-905b-1d3232e15965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (289735dc-b6cd-404f-905b-1d3232e15965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1918380090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be594061-7980-4dac-b531-a5b742c30e3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f556617c7c64576aa8eed133e849c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:49:12Z,use_quota=True,user_id='d04de16868fc45639cf91eed5d3aefea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a3d35d6-483d-430b-af58-edf7f72af5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a3d35d6-483d-430b-af58-edf7f72af5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4aa297b-60e6-44d6-a713-ac99a3202cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4aa297b-60e6-44d6-a713-ac99a3202cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be594061-7980-4dac-b531-a5b742c30e3b', 'volume_name': 'volume-be594061-7980-4dac-b531-a5b742c30e3b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92227de-906c-4218-996b-1c5e957cae40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92227de-906c-4218-996b-1c5e957cae40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3de1540-ce48-4488-826d-2cb2caabd846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:12 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] Volume be594061-7980-4dac-b531-a5b742c30e3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be594061-7980-4dac-b531-a5b742c30e3b', 'volume_size': 1} Sep 05 11:49:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1918380090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be594061-7980-4dac-b531-a5b742c30e3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f556617c7c64576aa8eed133e849c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:49:12Z,use_quota=True,user_id='d04de16868fc45639cf91eed5d3aefea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:49:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] Creating volume be594061-7980-4dac-b531-a5b742c30e3b {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:49:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:49:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:49:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:49:12 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:49:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:12 devstack sudo[104100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b 1073741824 Sep 05 11:49:12 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:12 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b 1073741824" returned: 0 in 0.479s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:12 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b Sep 05 11:49:12 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:13 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b" returned: 0 in 0.260s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:49:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3de1540-ce48-4488-826d-2cb2caabd846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be594061-7980-4dac-b531-a5b742c30e3b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46510ca3-49e3-4c69-9664-aeec147eca08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:13 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] Volume volume-be594061-7980-4dac-b531-a5b742c30e3b (be594061-7980-4dac-b531-a5b742c30e3b): created successfully Sep 05 11:49:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46510ca3-49e3-4c69-9664-aeec147eca08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] Flow 'volume_create_manager' (e53974dc-1022-4264-acbc-09468b774748) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:49:13 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-1d76015f-3d55-42da-8c49-d97c042e8901 tempest-VolumesSnapshotTestJSON-1655972575 None] Created volume successfully. Sep 05 11:49:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12557cbe-a8ed-43d1-b1bd-c16d39fbeb7e tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12557cbe-a8ed-43d1-b1bd-c16d39fbeb7e tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-12557cbe-a8ed-43d1-b1bd-c16d39fbeb7e tempest-VolumesSnapshotTestJSON-1655972575 None] Creating offline snapshot 3399ec81-a02c-4915-bca2-fe66247626bb of volume be594061-7980-4dac-b531-a5b742c30e3b {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:49:14 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3f2bb1-1eb1-4eaa-8493-9a23d359836e]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12557cbe-a8ed-43d1-b1bd-c16d39fbeb7e tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:14 devstack sudo[104110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b Sep 05 11:49:14 devstack sudo[104110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:14 devstack sudo[104110]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12557cbe-a8ed-43d1-b1bd-c16d39fbeb7e tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b" returned: 0 in 0.362s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12557cbe-a8ed-43d1-b1bd-c16d39fbeb7e tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b.3399ec81-a02c-4915-bca2-fe66247626bb 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:14 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b.3399ec81-a02c-4915-bca2-fe66247626bb 1G Sep 05 11:49:14 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:15 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12557cbe-a8ed-43d1-b1bd-c16d39fbeb7e tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b.3399ec81-a02c-4915-bca2-fe66247626bb 1G" returned: 0 in 0.387s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12557cbe-a8ed-43d1-b1bd-c16d39fbeb7e tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be594061-7980-4dac-b531-a5b742c30e3b -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b.3399ec81-a02c-4915-bca2-fe66247626bb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:15 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be594061-7980-4dac-b531-a5b742c30e3b -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b.3399ec81-a02c-4915-bca2-fe66247626bb Sep 05 11:49:15 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:15 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12557cbe-a8ed-43d1-b1bd-c16d39fbeb7e tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be594061-7980-4dac-b531-a5b742c30e3b -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b.3399ec81-a02c-4915-bca2-fe66247626bb" returned: 0 in 0.292s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:15 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-12557cbe-a8ed-43d1-b1bd-c16d39fbeb7e tempest-VolumesSnapshotTestJSON-1655972575 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b.3399ec81-a02c-4915-bca2-fe66247626bb is being set with open permissions: ugo+rw Sep 05 11:49:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12557cbe-a8ed-43d1-b1bd-c16d39fbeb7e tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b.3399ec81-a02c-4915-bca2-fe66247626bb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:15 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b.3399ec81-a02c-4915-bca2-fe66247626bb Sep 05 11:49:15 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:15 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12557cbe-a8ed-43d1-b1bd-c16d39fbeb7e tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b.3399ec81-a02c-4915-bca2-fe66247626bb" returned: 0 in 0.259s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12557cbe-a8ed-43d1-b1bd-c16d39fbeb7e tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:15 devstack sudo[104129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b.info Sep 05 11:49:15 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:15 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12557cbe-a8ed-43d1-b1bd-c16d39fbeb7e tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b.info" returned: 0 in 0.265s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:15 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-12557cbe-a8ed-43d1-b1bd-c16d39fbeb7e tempest-VolumesSnapshotTestJSON-1655972575 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b.info is being set with open permissions: ugo+rw Sep 05 11:49:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12557cbe-a8ed-43d1-b1bd-c16d39fbeb7e tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:16 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b.info Sep 05 11:49:16 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:16 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-12557cbe-a8ed-43d1-b1bd-c16d39fbeb7e tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b.info" returned: 0 in 0.238s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-12557cbe-a8ed-43d1-b1bd-c16d39fbeb7e tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.889s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:16 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-12557cbe-a8ed-43d1-b1bd-c16d39fbeb7e tempest-VolumesSnapshotTestJSON-1655972575 None] Create snapshot completed successfully Sep 05 11:49:16 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:49:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Flow 'volume_create_manager' (fb11971a-0a91-430b-8ce4-f405dc54cfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:49:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb074351-4f16-4da3-9c44-e53d3aa9bc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb074351-4f16-4da3-9c44-e53d3aa9bc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb70e956-898b-44bb-83c8-2ce4aa0ce292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a879cc6f58145d78dd71d66cf986547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:49:16Z,use_quota=True,user_id='26fe29d19b2f40c1b9cd2b3448fe1859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5163f2d-dd92-450e-83fc-1e25e40b0604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5163f2d-dd92-450e-83fc-1e25e40b0604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d6508b7-8fbd-4358-beff-ff1a0294a61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:16 devstack cinder-volume[87517]: DEBUG cinder.image.glance [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Creating Keystone auth plugin from conf {{(pid=87517) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 11:49:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d6508b7-8fbd-4358-beff-ff1a0294a61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cb70e956-898b-44bb-83c8-2ce4aa0ce292', 'volume_name': 'volume-cb70e956-898b-44bb-83c8-2ce4aa0ce292', 'volume_size': 1, 'image_id': 'a856a835-e465-431e-8068-e0f3b746d45e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a856a835-e465-431e-8068-e0f3b746d45e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1c504a43bdb83267c68c9dbac07b4ddf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4a879cc6f58145d78dd71d66cf986547', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9e06dd22a465e22a4cf36dc1ff08af0cc07503dcef9af4213e6a3d6cd486c04846e10ae1bb404882a62e94e0e78bdf38335ecb43857c91705f1d3b022c6723a4', 'id': 'a856a835-e465-431e-8068-e0f3b746d45e', 'created_at': datetime.datetime(2026, 9, 5, 9, 49, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 9, 49, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a856a835-e465-431e-8068-e0f3b746d45e/file', 'properties': {}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45a1b717-204c-4aeb-9524-02d9bf64deee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45a1b717-204c-4aeb-9524-02d9bf64deee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f60f4f28-e40e-49e2-b0ec-750ac849e9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:16 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Volume cb70e956-898b-44bb-83c8-2ce4aa0ce292: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cb70e956-898b-44bb-83c8-2ce4aa0ce292', 'volume_size': 1, 'image_id': 'a856a835-e465-431e-8068-e0f3b746d45e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a856a835-e465-431e-8068-e0f3b746d45e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1c504a43bdb83267c68c9dbac07b4ddf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4a879cc6f58145d78dd71d66cf986547', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9e06dd22a465e22a4cf36dc1ff08af0cc07503dcef9af4213e6a3d6cd486c04846e10ae1bb404882a62e94e0e78bdf38335ecb43857c91705f1d3b022c6723a4', 'id': 'a856a835-e465-431e-8068-e0f3b746d45e', 'created_at': datetime.datetime(2026, 9, 5, 9, 49, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 9, 49, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a856a835-e465-431e-8068-e0f3b746d45e/file', 'properties': {}}, 'image_service': } Sep 05 11:49:16 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Trying to clone cb70e956-898b-44bb-83c8-2ce4aa0ce292 from image a856a835-e465-431e-8068-e0f3b746d45e at location (None, [{'url': 'file:///opt/stack/data/glance/images/a856a835-e465-431e-8068-e0f3b746d45e', 'metadata': {}}]). {{(pid=87517) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 11:49:16 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a856a835-e465-431e-8068-e0f3b746d45e_c38qp_sedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 11:49:16 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Image download 0.00 MB at 0.00 MB/s Sep 05 11:49:16 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86d14ae-e460-4844-904e-cfaae2df1409]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a856a835-e465-431e-8068-e0f3b746d45e_c38qp_sedevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Flow 'volume_create_manager' (1cb8ecb5-251d-4635-93e6-ab6680a7416c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84cf3d95-1d07-4f8f-8738-d740626c1a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84cf3d95-1d07-4f8f-8738-d740626c1a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1012088086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=613af6bd-950c-4f89-b3e6-2cf4bc02a6cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f556617c7c64576aa8eed133e849c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:49:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=3399ec81-a02c-4915-bca2-fe66247626bb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:49:17Z,use_quota=True,user_id='d04de16868fc45639cf91eed5d3aefea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b746f5b9-58a7-4f23-8648-8e2157015cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b746f5b9-58a7-4f23-8648-8e2157015cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:17 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a856a835-e465-431e-8068-e0f3b746d45e_c38qp_sedevstack@QuobyteHD Sep 05 11:49:17 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6778a20-ab09-4ce9-bbd5-11a84b096c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6778a20-ab09-4ce9-bbd5-11a84b096c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '613af6bd-950c-4f89-b3e6-2cf4bc02a6cc', 'volume_name': 'volume-613af6bd-950c-4f89-b3e6-2cf4bc02a6cc', 'volume_size': 2, 'snapshot_id': '3399ec81-a02c-4915-bca2-fe66247626bb'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c76881-85d1-487f-b82c-2e2a72a91a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c76881-85d1-487f-b82c-2e2a72a91a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2653493-9719-4661-8a45-1ac67912daf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:17 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Volume 613af6bd-950c-4f89-b3e6-2cf4bc02a6cc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-613af6bd-950c-4f89-b3e6-2cf4bc02a6cc', 'volume_size': 2, 'snapshot_id': '3399ec81-a02c-4915-bca2-fe66247626bb'} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "cinder-quobyte-3399ec81-a02c-4915-bca2-fe66247626bb-613af6bd-950c-4f89-b3e6-2cf4bc02a6cc" by "_create_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-quobyte-3399ec81-a02c-4915-bca2-fe66247626bb-613af6bd-950c-4f89-b3e6-2cf4bc02a6cc" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Creating volume 613af6bd-950c-4f89-b3e6-2cf4bc02a6cc from snapshot 3399ec81-a02c-4915-bca2-fe66247626bb {{(pid=87517) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "cinder-quobyte-613af6bd-950c-4f89-b3e6-2cf4bc02a6cc" by "_copy_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-quobyte-613af6bd-950c-4f89-b3e6-2cf4bc02a6cc" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] snapshot: 3399ec81-a02c-4915-bca2-fe66247626bb, volume: 613af6bd-950c-4f89-b3e6-2cf4bc02a6cc, {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fceac7-e8cb-4aa7-a1a0-1743db5427d4]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b.3399ec81-a02c-4915-bca2-fe66247626bb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:17 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a856a835-e465-431e-8068-e0f3b746d45e_c38qp_sedevstack@QuobyteHD" returned: 0 in 0.322s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a856a835-e465-431e-8068-e0f3b746d45e_c38qp_sedevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:17 devstack sudo[104137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b.3399ec81-a02c-4915-bca2-fe66247626bb Sep 05 11:49:17 devstack sudo[104137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:17 devstack sudo[104140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a856a835-e465-431e-8068-e0f3b746d45e_c38qp_sedevstack@QuobyteHD Sep 05 11:49:17 devstack sudo[104140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:17 devstack sudo[104137]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b.3399ec81-a02c-4915-bca2-fe66247626bb" returned: 0 in 0.357s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be594061-7980-4dac-b531-a5b742c30e3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a321750e-3ccb-4fbb-8115-211fb2f23165]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:17 devstack sudo[104140]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a856a835-e465-431e-8068-e0f3b746d45e_c38qp_sedevstack@QuobyteHD" returned: 1 in 0.329s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a856a835-e465-431e-8068-e0f3b746d45e_c38qp_sedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Temporary image a856a835-e465-431e-8068-e0f3b746d45e is fetched for user 26fe29d19b2f40c1b9cd2b3448fe1859. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 11:49:17 devstack sudo[104146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b Sep 05 11:49:17 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d23efb9-c3e5-4734-81d7-b2f10bfd2765]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a856a835-e465-431e-8068-e0f3b746d45e_c38qp_sedevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:17 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a856a835-e465-431e-8068-e0f3b746d45e_c38qp_sedevstack@QuobyteHD Sep 05 11:49:17 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:17 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b" returned: 0 in 0.358s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Creating direct copy from snapshot {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG cinder.utils [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Path /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-613af6bd-950c-4f89-b3e6-2cf4bc02a6cc not found in is_blk_device check {{(pid=87517) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 11:49:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-613af6bd-950c-4f89-b3e6-2cf4bc02a6cc {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:17 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-613af6bd-950c-4f89-b3e6-2cf4bc02a6cc Sep 05 11:49:17 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:18 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a856a835-e465-431e-8068-e0f3b746d45e_c38qp_sedevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a856a835-e465-431e-8068-e0f3b746d45e_c38qp_sedevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:18 devstack sudo[104160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a856a835-e465-431e-8068-e0f3b746d45e_c38qp_sedevstack@QuobyteHD Sep 05 11:49:18 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:18 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a856a835-e465-431e-8068-e0f3b746d45e_c38qp_sedevstack@QuobyteHD" returned: 1 in 0.329s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a856a835-e465-431e-8068-e0f3b746d45e_c38qp_sedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 11:49:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:22 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-613af6bd-950c-4f89-b3e6-2cf4bc02a6cc" returned: 0 in 4.141s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:22 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Image conversion details: src /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b, size 1024.00 MB, duration 4.14 sec, destination /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-613af6bd-950c-4f89-b3e6-2cf4bc02a6cc {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 11:49:22 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Converted 1024.00 MB image at 247.21 MB/s Sep 05 11:49:22 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-613af6bd-950c-4f89-b3e6-2cf4bc02a6cc is being set with open permissions: ugo+rw Sep 05 11:49:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-613af6bd-950c-4f89-b3e6-2cf4bc02a6cc {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:22 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-613af6bd-950c-4f89-b3e6-2cf4bc02a6cc Sep 05 11:49:22 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:22 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-613af6bd-950c-4f89-b3e6-2cf4bc02a6cc" returned: 0 in 0.234s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-quobyte-613af6bd-950c-4f89-b3e6-2cf4bc02a6cc" released by "_copy_volume_from_snapshot" :: held 5.174s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-quobyte-3399ec81-a02c-4915-bca2-fe66247626bb-613af6bd-950c-4f89-b3e6-2cf4bc02a6cc" released by "_create_volume_from_snapshot" :: held 5.237s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.254s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.999s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb70e956-898b-44bb-83c8-2ce4aa0ce292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a879cc6f58145d78dd71d66cf986547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:49:16Z,use_quota=True,user_id='26fe29d19b2f40c1b9cd2b3448fe1859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:49:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Creating volume cb70e956-898b-44bb-83c8-2ce4aa0ce292 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:49:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:49:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:49:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:49:22 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:49:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cb70e956-898b-44bb-83c8-2ce4aa0ce292 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:22 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cb70e956-898b-44bb-83c8-2ce4aa0ce292 1073741824 Sep 05 11:49:22 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2653493-9719-4661-8a45-1ac67912daf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-613af6bd-950c-4f89-b3e6-2cf4bc02a6cc', 'volume_size': 2, 'snapshot_id': '3399ec81-a02c-4915-bca2-fe66247626bb'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b31557-272e-463b-980d-c6612dd1470d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:22 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Volume volume-613af6bd-950c-4f89-b3e6-2cf4bc02a6cc (613af6bd-950c-4f89-b3e6-2cf4bc02a6cc): created successfully Sep 05 11:49:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b31557-272e-463b-980d-c6612dd1470d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Flow 'volume_create_manager' (1cb8ecb5-251d-4635-93e6-ab6680a7416c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:49:22 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f52f615d-f836-41f9-bcfb-0626b33c1b08 tempest-VolumesSnapshotTestJSON-1655972575 None] Created volume successfully. Sep 05 11:49:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1fbdd593-e722-46e1-add5-fb7d3a62f068 tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "cinder-613af6bd-950c-4f89-b3e6-2cf4bc02a6cc-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1fbdd593-e722-46e1-add5-fb7d3a62f068 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-613af6bd-950c-4f89-b3e6-2cf4bc02a6cc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1fbdd593-e722-46e1-add5-fb7d3a62f068 tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "cinder-quobyte-613af6bd-950c-4f89-b3e6-2cf4bc02a6cc" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1fbdd593-e722-46e1-add5-fb7d3a62f068 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-quobyte-613af6bd-950c-4f89-b3e6-2cf4bc02a6cc" acquired by "delete_volume" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:22 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1275032c-0400-4ccc-b759-614f46753305]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1fbdd593-e722-46e1-add5-fb7d3a62f068 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-613af6bd-950c-4f89-b3e6-2cf4bc02a6cc {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:22 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cb70e956-898b-44bb-83c8-2ce4aa0ce292 1073741824" returned: 0 in 0.481s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:22 devstack sudo[104187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-613af6bd-950c-4f89-b3e6-2cf4bc02a6cc Sep 05 11:49:22 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cb70e956-898b-44bb-83c8-2ce4aa0ce292 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:22 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cb70e956-898b-44bb-83c8-2ce4aa0ce292 Sep 05 11:49:22 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:23 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1fbdd593-e722-46e1-add5-fb7d3a62f068 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-613af6bd-950c-4f89-b3e6-2cf4bc02a6cc" returned: 0 in 0.360s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1fbdd593-e722-46e1-add5-fb7d3a62f068 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-613af6bd-950c-4f89-b3e6-2cf4bc02a6cc {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:23 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:23 devstack sudo[104195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-613af6bd-950c-4f89-b3e6-2cf4bc02a6cc Sep 05 11:49:23 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cb70e956-898b-44bb-83c8-2ce4aa0ce292" returned: 0 in 0.247s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Attempting download of a856a835-e465-431e-8068-e0f3b746d45e ((None, [{'url': 'file:///opt/stack/data/glance/images/a856a835-e465-431e-8068-e0f3b746d45e', 'metadata': {}}])) to volume cb70e956-898b-44bb-83c8-2ce4aa0ce292. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62a93b2-e51a-492b-b69b-36e4997eae60]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a856a835-e465-431e-8068-e0f3b746d45e_b_9k1m0s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:23 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a856a835-e465-431e-8068-e0f3b746d45e_b_9k1m0s Sep 05 11:49:23 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:23 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1fbdd593-e722-46e1-add5-fb7d3a62f068 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-613af6bd-950c-4f89-b3e6-2cf4bc02a6cc" returned: 0 in 0.250s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1fbdd593-e722-46e1-add5-fb7d3a62f068 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-quobyte-613af6bd-950c-4f89-b3e6-2cf4bc02a6cc" released by "delete_volume" :: held 0.652s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-1fbdd593-e722-46e1-add5-fb7d3a62f068 tempest-VolumesSnapshotTestJSON-1655972575 None] Created reservations ['7c86a135-4250-4288-92fe-3cd3fa00ef39', 'b50dd968-def5-4cdc-bc97-80f9120bd9f5', 'ca81622f-1cd9-46e8-b19d-5d3042f400ad', '28533a0f-c6d9-45ee-b921-ed9dd5c99e94'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1fbdd593-e722-46e1-add5-fb7d3a62f068 tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1fbdd593-e722-46e1-add5-fb7d3a62f068 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1fbdd593-e722-46e1-add5-fb7d3a62f068 tempest-VolumesSnapshotTestJSON-1655972575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1fbdd593-e722-46e1-add5-fb7d3a62f068 tempest-VolumesSnapshotTestJSON-1655972575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1fbdd593-e722-46e1-add5-fb7d3a62f068 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1fbdd593-e722-46e1-add5-fb7d3a62f068 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:23 devstack sudo[104200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:49:23 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:23 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a856a835-e465-431e-8068-e0f3b746d45e_b_9k1m0s" returned: 0 in 0.367s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a856a835-e465-431e-8068-e0f3b746d45e_b_9k1m0s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:23 devstack sudo[104204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a856a835-e465-431e-8068-e0f3b746d45e_b_9k1m0s Sep 05 11:49:23 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:23 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1fbdd593-e722-46e1-add5-fb7d3a62f068 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.273s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-1fbdd593-e722-46e1-add5-fb7d3a62f068 tempest-VolumesSnapshotTestJSON-1655972575 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:49:23 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-1fbdd593-e722-46e1-add5-fb7d3a62f068 tempest-VolumesSnapshotTestJSON-1655972575 None] Deleted volume successfully. Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1fbdd593-e722-46e1-add5-fb7d3a62f068 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-613af6bd-950c-4f89-b3e6-2cf4bc02a6cc-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-cc151c96-a29f-488c-b6a7-1ace0cc26406 tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "cinder-3399ec81-a02c-4915-bca2-fe66247626bb-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-cc151c96-a29f-488c-b6a7-1ace0cc26406 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-3399ec81-a02c-4915-bca2-fe66247626bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-cc151c96-a29f-488c-b6a7-1ace0cc26406 tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "cinder-quobyte-be594061-7980-4dac-b531-a5b742c30e3b" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-cc151c96-a29f-488c-b6a7-1ace0cc26406 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-quobyte-be594061-7980-4dac-b531-a5b742c30e3b" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-cc151c96-a29f-488c-b6a7-1ace0cc26406 tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "cinder-quobyte-3399ec81-a02c-4915-bca2-fe66247626bb" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-cc151c96-a29f-488c-b6a7-1ace0cc26406 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-quobyte-3399ec81-a02c-4915-bca2-fe66247626bb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-cc151c96-a29f-488c-b6a7-1ace0cc26406 tempest-VolumesSnapshotTestJSON-1655972575 None] Deleting offline snapshot 3399ec81-a02c-4915-bca2-fe66247626bb of volume be594061-7980-4dac-b531-a5b742c30e3b {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-cc151c96-a29f-488c-b6a7-1ace0cc26406 tempest-VolumesSnapshotTestJSON-1655972575 None] snapshot_file for this snap is: volume-be594061-7980-4dac-b531-a5b742c30e3b.3399ec81-a02c-4915-bca2-fe66247626bb {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:49:23 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a856a835-e465-431e-8068-e0f3b746d45e_b_9k1m0s" returned: 1 in 0.365s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a856a835-e465-431e-8068-e0f3b746d45e_b_9k1m0s' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7d97ff-f458-40a5-a6fa-b4f60df64f2c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cc151c96-a29f-488c-b6a7-1ace0cc26406 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b.3399ec81-a02c-4915-bca2-fe66247626bb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff69aef0-b4f5-4861-8b50-affda96ed1bb]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a856a835-e465-431e-8068-e0f3b746d45e_c38qp_sedevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:24 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b.3399ec81-a02c-4915-bca2-fe66247626bb Sep 05 11:49:24 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:24 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a856a835-e465-431e-8068-e0f3b746d45e_c38qp_sedevstack@QuobyteHD Sep 05 11:49:24 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:24 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:24 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a856a835-e465-431e-8068-e0f3b746d45e_c38qp_sedevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a856a835-e465-431e-8068-e0f3b746d45e_c38qp_sedevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cc151c96-a29f-488c-b6a7-1ace0cc26406 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b.3399ec81-a02c-4915-bca2-fe66247626bb" returned: 0 in 0.371s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-cc151c96-a29f-488c-b6a7-1ace0cc26406 tempest-VolumesSnapshotTestJSON-1655972575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be594061-7980-4dac-b531-a5b742c30e3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:49:24 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[59286adc-a606-4183-9771-87bf6f9950fe]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cc151c96-a29f-488c-b6a7-1ace0cc26406 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:24 devstack sudo[104221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a856a835-e465-431e-8068-e0f3b746d45e_c38qp_sedevstack@QuobyteHD Sep 05 11:49:24 devstack sudo[104221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:24 devstack sudo[104222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b Sep 05 11:49:24 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:24 devstack sudo[104221]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a856a835-e465-431e-8068-e0f3b746d45e_c38qp_sedevstack@QuobyteHD" returned: 1 in 0.356s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a856a835-e465-431e-8068-e0f3b746d45e_c38qp_sedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 11:49:24 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] a856a835-e465-431e-8068-e0f3b746d45e was raw, converting to qcow2 {{(pid=87517) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 11:49:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a856a835-e465-431e-8068-e0f3b746d45e_c38qp_sedevstack@QuobyteHD /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cb70e956-898b-44bb-83c8-2ce4aa0ce292 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:24 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a856a835-e465-431e-8068-e0f3b746d45e_c38qp_sedevstack@QuobyteHD /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cb70e956-898b-44bb-83c8-2ce4aa0ce292 Sep 05 11:49:24 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:24 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cc151c96-a29f-488c-b6a7-1ace0cc26406 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b" returned: 0 in 0.550s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cc151c96-a29f-488c-b6a7-1ace0cc26406 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b.3399ec81-a02c-4915-bca2-fe66247626bb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:24 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b.3399ec81-a02c-4915-bca2-fe66247626bb Sep 05 11:49:24 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:25 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a856a835-e465-431e-8068-e0f3b746d45e_c38qp_sedevstack@QuobyteHD /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cb70e956-898b-44bb-83c8-2ce4aa0ce292" returned: 0 in 0.470s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:25 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a856a835-e465-431e-8068-e0f3b746d45e_c38qp_sedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cb70e956-898b-44bb-83c8-2ce4aa0ce292 {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 11:49:25 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Converted 0.00 MB image at 0.00 MB/s Sep 05 11:49:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cb70e956-898b-44bb-83c8-2ce4aa0ce292 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:25 devstack sudo[104241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cb70e956-898b-44bb-83c8-2ce4aa0ce292 1G Sep 05 11:49:25 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:25 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cc151c96-a29f-488c-b6a7-1ace0cc26406 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b.3399ec81-a02c-4915-bca2-fe66247626bb" returned: 0 in 0.384s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cc151c96-a29f-488c-b6a7-1ace0cc26406 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b.3399ec81-a02c-4915-bca2-fe66247626bb {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:25 devstack sudo[104245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b.3399ec81-a02c-4915-bca2-fe66247626bb Sep 05 11:49:25 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:25 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cb70e956-898b-44bb-83c8-2ce4aa0ce292 1G" returned: 0 in 0.338s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:25 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Downloaded image a856a835-e465-431e-8068-e0f3b746d45e ((None, [{'url': 'file:///opt/stack/data/glance/images/a856a835-e465-431e-8068-e0f3b746d45e', 'metadata': {}}])) to volume cb70e956-898b-44bb-83c8-2ce4aa0ce292 successfully. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 11:49:25 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Temporary image a856a835-e465-431e-8068-e0f3b746d45e for user 26fe29d19b2f40c1b9cd2b3448fe1859 is deleted. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 11:49:25 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Marking volume cb70e956-898b-44bb-83c8-2ce4aa0ce292 as bootable. {{(pid=87517) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 11:49:25 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Copying metadata from image a856a835-e465-431e-8068-e0f3b746d45e to cb70e956-898b-44bb-83c8-2ce4aa0ce292. {{(pid=87517) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 11:49:25 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Creating volume glance metadata for volume cb70e956-898b-44bb-83c8-2ce4aa0ce292 backed by image a856a835-e465-431e-8068-e0f3b746d45e with: {'image_id': 'a856a835-e465-431e-8068-e0f3b746d45e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1c504a43bdb83267c68c9dbac07b4ddf', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87517) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 11:49:25 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f60f4f28-e40e-49e2-b0ec-750ac849e9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb70e956-898b-44bb-83c8-2ce4aa0ce292', 'volume_size': 1, 'image_id': 'a856a835-e465-431e-8068-e0f3b746d45e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a856a835-e465-431e-8068-e0f3b746d45e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1c504a43bdb83267c68c9dbac07b4ddf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4a879cc6f58145d78dd71d66cf986547', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9e06dd22a465e22a4cf36dc1ff08af0cc07503dcef9af4213e6a3d6cd486c04846e10ae1bb404882a62e94e0e78bdf38335ecb43857c91705f1d3b022c6723a4', 'id': 'a856a835-e465-431e-8068-e0f3b746d45e', 'created_at': datetime.datetime(2026, 9, 5, 9, 49, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 9, 49, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a856a835-e465-431e-8068-e0f3b746d45e/file', 'properties': {}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923d4b32-59c0-416d-aa8a-a6cabb6fde37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cc151c96-a29f-488c-b6a7-1ace0cc26406 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b.3399ec81-a02c-4915-bca2-fe66247626bb" returned: 0 in 0.283s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:25 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Volume volume-cb70e956-898b-44bb-83c8-2ce4aa0ce292 (cb70e956-898b-44bb-83c8-2ce4aa0ce292): created successfully Sep 05 11:49:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923d4b32-59c0-416d-aa8a-a6cabb6fde37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Flow 'volume_create_manager' (fb11971a-0a91-430b-8ce4-f405dc54cfcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:49:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-cc151c96-a29f-488c-b6a7-1ace0cc26406 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-quobyte-3399ec81-a02c-4915-bca2-fe66247626bb" released by "_delete_snapshot" :: held 1.700s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-cc151c96-a29f-488c-b6a7-1ace0cc26406 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-quobyte-be594061-7980-4dac-b531-a5b742c30e3b" released by "delete_snapshot" :: held 1.726s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:25 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-00071bda-87c0-4386-9db8-5aeb236735e8 tempest-VolumeImageDependencyTests-1016567039 None] Created volume successfully. Sep 05 11:49:25 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-cc151c96-a29f-488c-b6a7-1ace0cc26406 tempest-VolumesSnapshotTestJSON-1655972575 None] Created reservations ['a240ba01-0df2-4a5c-801f-c27561d2de7f', 'e8c33356-e1d5-4bb3-85e8-b56ae2cfa064', '8c39854a-d24a-4abb-b31f-3146736e0b75', 'f997070c-7095-4d4d-bba9-e6a821919330'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:49:25 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-cc151c96-a29f-488c-b6a7-1ace0cc26406 tempest-VolumesSnapshotTestJSON-1655972575 None] Delete snapshot completed successfully. Sep 05 11:49:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-cc151c96-a29f-488c-b6a7-1ace0cc26406 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-3399ec81-a02c-4915-bca2-fe66247626bb-delete_snapshot" released by "delete_snapshot" :: held 1.861s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-aa9793c5-5071-41bc-93ac-f3cf66194c31 tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "cinder-be594061-7980-4dac-b531-a5b742c30e3b-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-aa9793c5-5071-41bc-93ac-f3cf66194c31 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-be594061-7980-4dac-b531-a5b742c30e3b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-aa9793c5-5071-41bc-93ac-f3cf66194c31 tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "cinder-quobyte-be594061-7980-4dac-b531-a5b742c30e3b" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-aa9793c5-5071-41bc-93ac-f3cf66194c31 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-quobyte-be594061-7980-4dac-b531-a5b742c30e3b" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:26 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b7ac63-efdc-4107-bf53-b783e439d82c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aa9793c5-5071-41bc-93ac-f3cf66194c31 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:26 devstack sudo[104251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b Sep 05 11:49:26 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-17d1d61c-02c3-478a-acb8-06fd1ee1cf45 tempest-VolumeImageDependencyTests-1016567039 None] Acquiring lock "cinder-cb70e956-898b-44bb-83c8-2ce4aa0ce292-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-17d1d61c-02c3-478a-acb8-06fd1ee1cf45 tempest-VolumeImageDependencyTests-1016567039 None] Lock "cinder-cb70e956-898b-44bb-83c8-2ce4aa0ce292-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-17d1d61c-02c3-478a-acb8-06fd1ee1cf45 tempest-VolumeImageDependencyTests-1016567039 None] Acquiring lock "cinder-quobyte-cb70e956-898b-44bb-83c8-2ce4aa0ce292" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-17d1d61c-02c3-478a-acb8-06fd1ee1cf45 tempest-VolumeImageDependencyTests-1016567039 None] Lock "cinder-quobyte-cb70e956-898b-44bb-83c8-2ce4aa0ce292" acquired by "delete_volume" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:26 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da25035-5d85-47e1-8c69-ccd0a9c49205]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-17d1d61c-02c3-478a-acb8-06fd1ee1cf45 tempest-VolumeImageDependencyTests-1016567039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cb70e956-898b-44bb-83c8-2ce4aa0ce292 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:26 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cb70e956-898b-44bb-83c8-2ce4aa0ce292 Sep 05 11:49:26 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:26 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aa9793c5-5071-41bc-93ac-f3cf66194c31 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b" returned: 0 in 0.392s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aa9793c5-5071-41bc-93ac-f3cf66194c31 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:26 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b Sep 05 11:49:26 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:26 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-17d1d61c-02c3-478a-acb8-06fd1ee1cf45 tempest-VolumeImageDependencyTests-1016567039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cb70e956-898b-44bb-83c8-2ce4aa0ce292" returned: 0 in 0.375s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-17d1d61c-02c3-478a-acb8-06fd1ee1cf45 tempest-VolumeImageDependencyTests-1016567039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cb70e956-898b-44bb-83c8-2ce4aa0ce292 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:26 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cb70e956-898b-44bb-83c8-2ce4aa0ce292 Sep 05 11:49:26 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:26 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aa9793c5-5071-41bc-93ac-f3cf66194c31 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-be594061-7980-4dac-b531-a5b742c30e3b" returned: 0 in 0.254s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-aa9793c5-5071-41bc-93ac-f3cf66194c31 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-quobyte-be594061-7980-4dac-b531-a5b742c30e3b" released by "delete_volume" :: held 0.708s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:26 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-aa9793c5-5071-41bc-93ac-f3cf66194c31 tempest-VolumesSnapshotTestJSON-1655972575 None] Created reservations ['fe33a2de-dcea-405a-8614-c4def2afa910', 'a0fcde8a-08b5-4809-bc3a-dd10ee8f56b1', 'c7e7e015-c219-4b77-996f-f0d87135ae66', 'b3705a40-8cf7-4800-9b4d-f66121a4ceec'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:49:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-aa9793c5-5071-41bc-93ac-f3cf66194c31 tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-aa9793c5-5071-41bc-93ac-f3cf66194c31 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-aa9793c5-5071-41bc-93ac-f3cf66194c31 tempest-VolumesSnapshotTestJSON-1655972575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-aa9793c5-5071-41bc-93ac-f3cf66194c31 tempest-VolumesSnapshotTestJSON-1655972575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-aa9793c5-5071-41bc-93ac-f3cf66194c31 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aa9793c5-5071-41bc-93ac-f3cf66194c31 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:27 devstack sudo[104267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:49:27 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:27 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-17d1d61c-02c3-478a-acb8-06fd1ee1cf45 tempest-VolumeImageDependencyTests-1016567039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-cb70e956-898b-44bb-83c8-2ce4aa0ce292" returned: 0 in 0.263s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-17d1d61c-02c3-478a-acb8-06fd1ee1cf45 tempest-VolumeImageDependencyTests-1016567039 None] Lock "cinder-quobyte-cb70e956-898b-44bb-83c8-2ce4aa0ce292" released by "delete_volume" :: held 0.680s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-17d1d61c-02c3-478a-acb8-06fd1ee1cf45 tempest-VolumeImageDependencyTests-1016567039 None] Created reservations ['ddcf7eda-417c-4fdc-9823-4a97e52bf747', 'b34b1d80-4198-41d5-8f70-f3b5f5bb3de9', 'aa27ccc7-160c-4de8-b18a-74e3661623b2', '4064c81d-ca88-4adc-a2e7-c0bfa22aa14c'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-17d1d61c-02c3-478a-acb8-06fd1ee1cf45 tempest-VolumeImageDependencyTests-1016567039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-17d1d61c-02c3-478a-acb8-06fd1ee1cf45 tempest-VolumeImageDependencyTests-1016567039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-17d1d61c-02c3-478a-acb8-06fd1ee1cf45 tempest-VolumeImageDependencyTests-1016567039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-17d1d61c-02c3-478a-acb8-06fd1ee1cf45 tempest-VolumeImageDependencyTests-1016567039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-17d1d61c-02c3-478a-acb8-06fd1ee1cf45 tempest-VolumeImageDependencyTests-1016567039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-17d1d61c-02c3-478a-acb8-06fd1ee1cf45 tempest-VolumeImageDependencyTests-1016567039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:27 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:49:27 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:27 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aa9793c5-5071-41bc-93ac-f3cf66194c31 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.286s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-aa9793c5-5071-41bc-93ac-f3cf66194c31 tempest-VolumesSnapshotTestJSON-1655972575 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:49:27 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-aa9793c5-5071-41bc-93ac-f3cf66194c31 tempest-VolumesSnapshotTestJSON-1655972575 None] Deleted volume successfully. Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-aa9793c5-5071-41bc-93ac-f3cf66194c31 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-be594061-7980-4dac-b531-a5b742c30e3b-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:27 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-17d1d61c-02c3-478a-acb8-06fd1ee1cf45 tempest-VolumeImageDependencyTests-1016567039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.299s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-17d1d61c-02c3-478a-acb8-06fd1ee1cf45 tempest-VolumeImageDependencyTests-1016567039 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:49:27 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-17d1d61c-02c3-478a-acb8-06fd1ee1cf45 tempest-VolumeImageDependencyTests-1016567039 None] Deleted volume successfully. Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-17d1d61c-02c3-478a-acb8-06fd1ee1cf45 tempest-VolumeImageDependencyTests-1016567039 None] Lock "cinder-cb70e956-898b-44bb-83c8-2ce4aa0ce292-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] Flow 'volume_create_manager' (54be7d98-0802-459c-9fc9-15273eaff476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e3090a8-9f91-43e4-9866-6f254eab4480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e3090a8-9f91-43e4-9866-6f254eab4480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1776379719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eda23bcf-d2dd-4abc-8b01-ea3188e55df0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f556617c7c64576aa8eed133e849c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:49:28Z,use_quota=True,user_id='d04de16868fc45639cf91eed5d3aefea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e5febe-78c0-4ad7-a8ff-a9bb474cb345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e5febe-78c0-4ad7-a8ff-a9bb474cb345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8b41410-c694-48e6-951d-a2dac5fbe2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8b41410-c694-48e6-951d-a2dac5fbe2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eda23bcf-d2dd-4abc-8b01-ea3188e55df0', 'volume_name': 'volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d3aea6-04eb-4e88-9c2d-31fdafb7fa56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d3aea6-04eb-4e88-9c2d-31fdafb7fa56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22f74019-3e0f-46f2-bd46-bcd9ccaa6a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:27 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] Volume eda23bcf-d2dd-4abc-8b01-ea3188e55df0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0', 'volume_size': 1} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1776379719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eda23bcf-d2dd-4abc-8b01-ea3188e55df0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f556617c7c64576aa8eed133e849c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:49:28Z,use_quota=True,user_id='d04de16868fc45639cf91eed5d3aefea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] Creating volume eda23bcf-d2dd-4abc-8b01-ea3188e55df0 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:49:27 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:49:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:27 devstack sudo[104273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0 1073741824 Sep 05 11:49:27 devstack sudo[104273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:28 devstack sudo[104273]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0 1073741824" returned: 0 in 0.436s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:28 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0 Sep 05 11:49:28 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:28 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0" returned: 0 in 0.276s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:49:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22f74019-3e0f-46f2-bd46-bcd9ccaa6a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (670d1bc7-628e-4a56-96ed-6705a8eaf162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:28 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] Volume volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0 (eda23bcf-d2dd-4abc-8b01-ea3188e55df0): created successfully Sep 05 11:49:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (670d1bc7-628e-4a56-96ed-6705a8eaf162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] Flow 'volume_create_manager' (54be7d98-0802-459c-9fc9-15273eaff476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:49:28 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d5ad664c-ca23-480f-8b67-dfbdb9474b4a tempest-VolumesSnapshotTestJSON-1655972575 None] Created volume successfully. Sep 05 11:49:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5e2c17e5-e433-4e4d-87fc-e5826e2c1c0f tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5e2c17e5-e433-4e4d-87fc-e5826e2c1c0f tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-5e2c17e5-e433-4e4d-87fc-e5826e2c1c0f tempest-VolumesSnapshotTestJSON-1655972575 None] Creating offline snapshot 712d8a78-487f-47bf-8f2e-f137850090cd of volume eda23bcf-d2dd-4abc-8b01-ea3188e55df0 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:49:29 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d9ba5d-db22-42c7-a560-035985ce0417]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5e2c17e5-e433-4e4d-87fc-e5826e2c1c0f tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:29 devstack sudo[104282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0 Sep 05 11:49:29 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:29 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5e2c17e5-e433-4e4d-87fc-e5826e2c1c0f tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0" returned: 0 in 0.425s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5e2c17e5-e433-4e4d-87fc-e5826e2c1c0f tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0.712d8a78-487f-47bf-8f2e-f137850090cd 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:29 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0.712d8a78-487f-47bf-8f2e-f137850090cd 1G Sep 05 11:49:29 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:29 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5e2c17e5-e433-4e4d-87fc-e5826e2c1c0f tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0.712d8a78-487f-47bf-8f2e-f137850090cd 1G" returned: 0 in 0.419s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5e2c17e5-e433-4e4d-87fc-e5826e2c1c0f tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0.712d8a78-487f-47bf-8f2e-f137850090cd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:29 devstack sudo[104292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0.712d8a78-487f-47bf-8f2e-f137850090cd Sep 05 11:49:30 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:30 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5e2c17e5-e433-4e4d-87fc-e5826e2c1c0f tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0.712d8a78-487f-47bf-8f2e-f137850090cd" returned: 0 in 0.291s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:30 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-5e2c17e5-e433-4e4d-87fc-e5826e2c1c0f tempest-VolumesSnapshotTestJSON-1655972575 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0.712d8a78-487f-47bf-8f2e-f137850090cd is being set with open permissions: ugo+rw Sep 05 11:49:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5e2c17e5-e433-4e4d-87fc-e5826e2c1c0f tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0.712d8a78-487f-47bf-8f2e-f137850090cd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:30 devstack sudo[104298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0.712d8a78-487f-47bf-8f2e-f137850090cd Sep 05 11:49:30 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:30 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5e2c17e5-e433-4e4d-87fc-e5826e2c1c0f tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0.712d8a78-487f-47bf-8f2e-f137850090cd" returned: 0 in 0.274s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5e2c17e5-e433-4e4d-87fc-e5826e2c1c0f tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:30 devstack sudo[104301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0.info Sep 05 11:49:30 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:30 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5e2c17e5-e433-4e4d-87fc-e5826e2c1c0f tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0.info" returned: 0 in 0.286s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:30 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-5e2c17e5-e433-4e4d-87fc-e5826e2c1c0f tempest-VolumesSnapshotTestJSON-1655972575 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0.info is being set with open permissions: ugo+rw Sep 05 11:49:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5e2c17e5-e433-4e4d-87fc-e5826e2c1c0f tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:30 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0.info Sep 05 11:49:30 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:31 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5e2c17e5-e433-4e4d-87fc-e5826e2c1c0f tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0.info" returned: 0 in 0.266s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5e2c17e5-e433-4e4d-87fc-e5826e2c1c0f tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.071s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:31 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-5e2c17e5-e433-4e4d-87fc-e5826e2c1c0f tempest-VolumesSnapshotTestJSON-1655972575 None] Create snapshot completed successfully Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:32 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:49:32 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:32 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.269s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread count: 28 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread info: [<_MainThread(MainThread, started 131707869511808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Flow 'volume_create_manager' (857f5f99-811c-4541-a3a8-e5330a668df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1565239-02de-487a-8849-a0e7245563d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1565239-02de-487a-8849-a0e7245563d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2024077252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85f183a3-8d75-4b81-9c85-7b826d467857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f556617c7c64576aa8eed133e849c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=712d8a78-487f-47bf-8f2e-f137850090cd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:49:33Z,use_quota=True,user_id='d04de16868fc45639cf91eed5d3aefea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50af73e8-6865-446b-aec1-d20899ff3a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50af73e8-6865-446b-aec1-d20899ff3a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (152984f8-e4e3-4f80-a9c3-fe8c429285d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (152984f8-e4e3-4f80-a9c3-fe8c429285d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '85f183a3-8d75-4b81-9c85-7b826d467857', 'volume_name': 'volume-85f183a3-8d75-4b81-9c85-7b826d467857', 'volume_size': 1, 'snapshot_id': '712d8a78-487f-47bf-8f2e-f137850090cd'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7790d630-5a3d-4f52-a6d1-b51ce43dc938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7790d630-5a3d-4f52-a6d1-b51ce43dc938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (658ee687-fa7f-4b0d-bd87-583e77170bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:32 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Volume 85f183a3-8d75-4b81-9c85-7b826d467857: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-85f183a3-8d75-4b81-9c85-7b826d467857', 'volume_size': 1, 'snapshot_id': '712d8a78-487f-47bf-8f2e-f137850090cd'} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "cinder-quobyte-712d8a78-487f-47bf-8f2e-f137850090cd-85f183a3-8d75-4b81-9c85-7b826d467857" by "_create_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-quobyte-712d8a78-487f-47bf-8f2e-f137850090cd-85f183a3-8d75-4b81-9c85-7b826d467857" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Creating volume 85f183a3-8d75-4b81-9c85-7b826d467857 from snapshot 712d8a78-487f-47bf-8f2e-f137850090cd {{(pid=87517) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "cinder-quobyte-85f183a3-8d75-4b81-9c85-7b826d467857" by "_copy_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-quobyte-85f183a3-8d75-4b81-9c85-7b826d467857" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] snapshot: 712d8a78-487f-47bf-8f2e-f137850090cd, volume: 85f183a3-8d75-4b81-9c85-7b826d467857, {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0defd1-0670-49c9-9ac5-61a1d3d37d9e]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0.712d8a78-487f-47bf-8f2e-f137850090cd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:33 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0.712d8a78-487f-47bf-8f2e-f137850090cd Sep 05 11:49:33 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:33 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0.712d8a78-487f-47bf-8f2e-f137850090cd" returned: 0 in 0.383s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:49:33 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[01adf3fa-1006-489e-982b-c839aa12c4a9]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:33 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0 Sep 05 11:49:33 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:33 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0" returned: 0 in 0.393s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0 {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 11:49:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Creating direct copy from snapshot {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 11:49:33 devstack cinder-volume[87517]: DEBUG cinder.utils [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Path /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85f183a3-8d75-4b81-9c85-7b826d467857 not found in is_blk_device check {{(pid=87517) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 11:49:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85f183a3-8d75-4b81-9c85-7b826d467857 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:33 devstack sudo[104321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85f183a3-8d75-4b81-9c85-7b826d467857 Sep 05 11:49:33 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:39 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85f183a3-8d75-4b81-9c85-7b826d467857" returned: 0 in 5.369s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:39 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Image conversion details: src /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0, size 1024.00 MB, duration 5.37 sec, destination /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85f183a3-8d75-4b81-9c85-7b826d467857 {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 11:49:39 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Converted 1024.00 MB image at 190.67 MB/s Sep 05 11:49:39 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85f183a3-8d75-4b81-9c85-7b826d467857 is being set with open permissions: ugo+rw Sep 05 11:49:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85f183a3-8d75-4b81-9c85-7b826d467857 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:39 devstack sudo[104370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85f183a3-8d75-4b81-9c85-7b826d467857 Sep 05 11:49:39 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:39 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85f183a3-8d75-4b81-9c85-7b826d467857" returned: 0 in 0.264s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-quobyte-85f183a3-8d75-4b81-9c85-7b826d467857" released by "_copy_volume_from_snapshot" :: held 6.502s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-quobyte-712d8a78-487f-47bf-8f2e-f137850090cd-85f183a3-8d75-4b81-9c85-7b826d467857" released by "_create_volume_from_snapshot" :: held 6.608s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.625s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (658ee687-fa7f-4b0d-bd87-583e77170bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85f183a3-8d75-4b81-9c85-7b826d467857', 'volume_size': 1, 'snapshot_id': '712d8a78-487f-47bf-8f2e-f137850090cd'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3a401c9-a843-4bef-be41-c792483c8d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:39 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Volume volume-85f183a3-8d75-4b81-9c85-7b826d467857 (85f183a3-8d75-4b81-9c85-7b826d467857): created successfully Sep 05 11:49:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3a401c9-a843-4bef-be41-c792483c8d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:39 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Flow 'volume_create_manager' (857f5f99-811c-4541-a3a8-e5330a668df2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:49:39 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e6fdd2d9-5961-4772-bebd-43e712985c1d tempest-VolumesSnapshotTestJSON-1655972575 None] Created volume successfully. Sep 05 11:49:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7cf6dab8-d288-456a-8189-9f0126026a88 tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "cinder-85f183a3-8d75-4b81-9c85-7b826d467857-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7cf6dab8-d288-456a-8189-9f0126026a88 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-85f183a3-8d75-4b81-9c85-7b826d467857-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7cf6dab8-d288-456a-8189-9f0126026a88 tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "cinder-quobyte-85f183a3-8d75-4b81-9c85-7b826d467857" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7cf6dab8-d288-456a-8189-9f0126026a88 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-quobyte-85f183a3-8d75-4b81-9c85-7b826d467857" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:40 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4897d748-89a5-4f9c-ab20-0efea7f34755]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7cf6dab8-d288-456a-8189-9f0126026a88 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85f183a3-8d75-4b81-9c85-7b826d467857 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:41 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85f183a3-8d75-4b81-9c85-7b826d467857 Sep 05 11:49:41 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:41 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7cf6dab8-d288-456a-8189-9f0126026a88 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85f183a3-8d75-4b81-9c85-7b826d467857" returned: 0 in 0.426s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7cf6dab8-d288-456a-8189-9f0126026a88 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85f183a3-8d75-4b81-9c85-7b826d467857 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:41 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85f183a3-8d75-4b81-9c85-7b826d467857 Sep 05 11:49:41 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:41 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7cf6dab8-d288-456a-8189-9f0126026a88 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85f183a3-8d75-4b81-9c85-7b826d467857" returned: 0 in 0.373s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7cf6dab8-d288-456a-8189-9f0126026a88 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-quobyte-85f183a3-8d75-4b81-9c85-7b826d467857" released by "delete_volume" :: held 0.861s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:41 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-7cf6dab8-d288-456a-8189-9f0126026a88 tempest-VolumesSnapshotTestJSON-1655972575 None] Created reservations ['ca2c26c7-daf3-4588-90ad-25967d652992', '21220978-34fe-4569-8156-c6a179f01da2', 'daac0066-d5f8-4b12-a17d-7791e9e097da', '9999a1cd-526f-4782-a589-18cb963874de'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:49:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7cf6dab8-d288-456a-8189-9f0126026a88 tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7cf6dab8-d288-456a-8189-9f0126026a88 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7cf6dab8-d288-456a-8189-9f0126026a88 tempest-VolumesSnapshotTestJSON-1655972575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:49:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7cf6dab8-d288-456a-8189-9f0126026a88 tempest-VolumesSnapshotTestJSON-1655972575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:49:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7cf6dab8-d288-456a-8189-9f0126026a88 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7cf6dab8-d288-456a-8189-9f0126026a88 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:41 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:49:41 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-62b460b7-2783-4416-b77d-e09689945d20 tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "cinder-712d8a78-487f-47bf-8f2e-f137850090cd-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-62b460b7-2783-4416-b77d-e09689945d20 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-712d8a78-487f-47bf-8f2e-f137850090cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-62b460b7-2783-4416-b77d-e09689945d20 tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "cinder-quobyte-eda23bcf-d2dd-4abc-8b01-ea3188e55df0" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-62b460b7-2783-4416-b77d-e09689945d20 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-quobyte-eda23bcf-d2dd-4abc-8b01-ea3188e55df0" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-62b460b7-2783-4416-b77d-e09689945d20 tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "cinder-quobyte-712d8a78-487f-47bf-8f2e-f137850090cd" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-62b460b7-2783-4416-b77d-e09689945d20 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-quobyte-712d8a78-487f-47bf-8f2e-f137850090cd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-62b460b7-2783-4416-b77d-e09689945d20 tempest-VolumesSnapshotTestJSON-1655972575 None] Deleting offline snapshot 712d8a78-487f-47bf-8f2e-f137850090cd of volume eda23bcf-d2dd-4abc-8b01-ea3188e55df0 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:49:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-62b460b7-2783-4416-b77d-e09689945d20 tempest-VolumesSnapshotTestJSON-1655972575 None] snapshot_file for this snap is: volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0.712d8a78-487f-47bf-8f2e-f137850090cd {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:49:42 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c91f83-5ca7-4163-ad68-bf937626bbe2]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-62b460b7-2783-4416-b77d-e09689945d20 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0.712d8a78-487f-47bf-8f2e-f137850090cd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:42 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7cf6dab8-d288-456a-8189-9f0126026a88 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.306s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:42 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-7cf6dab8-d288-456a-8189-9f0126026a88 tempest-VolumesSnapshotTestJSON-1655972575 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:49:42 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7cf6dab8-d288-456a-8189-9f0126026a88 tempest-VolumesSnapshotTestJSON-1655972575 None] Deleted volume successfully. Sep 05 11:49:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7cf6dab8-d288-456a-8189-9f0126026a88 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-85f183a3-8d75-4b81-9c85-7b826d467857-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:42 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0.712d8a78-487f-47bf-8f2e-f137850090cd Sep 05 11:49:42 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:42 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-62b460b7-2783-4416-b77d-e09689945d20 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0.712d8a78-487f-47bf-8f2e-f137850090cd" returned: 0 in 0.425s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-62b460b7-2783-4416-b77d-e09689945d20 tempest-VolumesSnapshotTestJSON-1655972575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:49:42 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eeff578-732c-454d-98e9-6e84cd782a99]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-62b460b7-2783-4416-b77d-e09689945d20 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:42 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0 Sep 05 11:49:42 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:43 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-62b460b7-2783-4416-b77d-e09689945d20 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0" returned: 0 in 0.576s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-62b460b7-2783-4416-b77d-e09689945d20 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0.712d8a78-487f-47bf-8f2e-f137850090cd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:43 devstack sudo[104396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0.712d8a78-487f-47bf-8f2e-f137850090cd Sep 05 11:49:43 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:43 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-62b460b7-2783-4416-b77d-e09689945d20 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0.712d8a78-487f-47bf-8f2e-f137850090cd" returned: 0 in 0.379s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-62b460b7-2783-4416-b77d-e09689945d20 tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0.712d8a78-487f-47bf-8f2e-f137850090cd {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:43 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0.712d8a78-487f-47bf-8f2e-f137850090cd Sep 05 11:49:43 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:43 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-62b460b7-2783-4416-b77d-e09689945d20 tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0.712d8a78-487f-47bf-8f2e-f137850090cd" returned: 0 in 0.260s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-62b460b7-2783-4416-b77d-e09689945d20 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-quobyte-712d8a78-487f-47bf-8f2e-f137850090cd" released by "_delete_snapshot" :: held 1.762s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-62b460b7-2783-4416-b77d-e09689945d20 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-quobyte-eda23bcf-d2dd-4abc-8b01-ea3188e55df0" released by "delete_snapshot" :: held 1.788s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:43 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-62b460b7-2783-4416-b77d-e09689945d20 tempest-VolumesSnapshotTestJSON-1655972575 None] Created reservations ['ba68a6e5-fa55-40be-a456-e96a2b1d25c7', '4bb00e18-e580-47d0-87d1-24cb1e619f40', 'a8ed229a-3909-4b74-a80e-91dd0ae51d70', '65f88f7c-99ae-4071-a3cc-6b5ffdc6cb7c'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:49:43 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-62b460b7-2783-4416-b77d-e09689945d20 tempest-VolumesSnapshotTestJSON-1655972575 None] Delete snapshot completed successfully. Sep 05 11:49:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-62b460b7-2783-4416-b77d-e09689945d20 tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-712d8a78-487f-47bf-8f2e-f137850090cd-delete_snapshot" released by "delete_snapshot" :: held 1.927s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4ce7e314-9294-45f9-9dde-1f80a09103dd tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "cinder-eda23bcf-d2dd-4abc-8b01-ea3188e55df0-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4ce7e314-9294-45f9-9dde-1f80a09103dd tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-eda23bcf-d2dd-4abc-8b01-ea3188e55df0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4ce7e314-9294-45f9-9dde-1f80a09103dd tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "cinder-quobyte-eda23bcf-d2dd-4abc-8b01-ea3188e55df0" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4ce7e314-9294-45f9-9dde-1f80a09103dd tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-quobyte-eda23bcf-d2dd-4abc-8b01-ea3188e55df0" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:44 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c6f333-9abd-4deb-8691-4262240eec25]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4ce7e314-9294-45f9-9dde-1f80a09103dd tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:44 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0 Sep 05 11:49:44 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:44 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4ce7e314-9294-45f9-9dde-1f80a09103dd tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0" returned: 0 in 0.363s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4ce7e314-9294-45f9-9dde-1f80a09103dd tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:44 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0 Sep 05 11:49:44 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:44 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4ce7e314-9294-45f9-9dde-1f80a09103dd tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eda23bcf-d2dd-4abc-8b01-ea3188e55df0" returned: 0 in 0.240s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4ce7e314-9294-45f9-9dde-1f80a09103dd tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-quobyte-eda23bcf-d2dd-4abc-8b01-ea3188e55df0" released by "delete_volume" :: held 0.664s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:45 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-4ce7e314-9294-45f9-9dde-1f80a09103dd tempest-VolumesSnapshotTestJSON-1655972575 None] Created reservations ['50d0f977-f3db-46d0-8dd7-478f786ef144', 'd9083a7a-a50b-4e1c-88aa-813fc5bb0752', '7e781858-70c3-4201-9dd1-2d8d4de3deba', 'fa832460-cbfc-41ba-9814-f9d60d59c1bb'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:49:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4ce7e314-9294-45f9-9dde-1f80a09103dd tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4ce7e314-9294-45f9-9dde-1f80a09103dd tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4ce7e314-9294-45f9-9dde-1f80a09103dd tempest-VolumesSnapshotTestJSON-1655972575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:49:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4ce7e314-9294-45f9-9dde-1f80a09103dd tempest-VolumesSnapshotTestJSON-1655972575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:49:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4ce7e314-9294-45f9-9dde-1f80a09103dd tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4ce7e314-9294-45f9-9dde-1f80a09103dd tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:45 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:49:45 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:45 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4ce7e314-9294-45f9-9dde-1f80a09103dd tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.287s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:45 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-4ce7e314-9294-45f9-9dde-1f80a09103dd tempest-VolumesSnapshotTestJSON-1655972575 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:49:45 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-4ce7e314-9294-45f9-9dde-1f80a09103dd tempest-VolumesSnapshotTestJSON-1655972575 None] Deleted volume successfully. Sep 05 11:49:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-4ce7e314-9294-45f9-9dde-1f80a09103dd tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-eda23bcf-d2dd-4abc-8b01-ea3188e55df0-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9640a3fc-6d77-42eb-81f2-cabf9610438d tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "cinder-0433c512-be81-4662-bea7-0bdf53d83108-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9640a3fc-6d77-42eb-81f2-cabf9610438d tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-0433c512-be81-4662-bea7-0bdf53d83108-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9640a3fc-6d77-42eb-81f2-cabf9610438d tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "cinder-quobyte-0433c512-be81-4662-bea7-0bdf53d83108" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9640a3fc-6d77-42eb-81f2-cabf9610438d tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-quobyte-0433c512-be81-4662-bea7-0bdf53d83108" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:45 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b44f85-fd31-4ae6-9249-00df104571c9]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9640a3fc-6d77-42eb-81f2-cabf9610438d tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:45 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108 Sep 05 11:49:45 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:46 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9640a3fc-6d77-42eb-81f2-cabf9610438d tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108" returned: 0 in 0.375s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9640a3fc-6d77-42eb-81f2-cabf9610438d tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:46 devstack sudo[104421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108 Sep 05 11:49:46 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:46 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9640a3fc-6d77-42eb-81f2-cabf9610438d tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0433c512-be81-4662-bea7-0bdf53d83108" returned: 0 in 0.241s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9640a3fc-6d77-42eb-81f2-cabf9610438d tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-quobyte-0433c512-be81-4662-bea7-0bdf53d83108" released by "delete_volume" :: held 0.682s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:46 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-9640a3fc-6d77-42eb-81f2-cabf9610438d tempest-VolumesSnapshotTestJSON-1655972575 None] Created reservations ['ff27806c-1bd4-4e55-8f70-3279b83cb7e4', 'd2bfef12-0e4a-4ffb-a313-9768d89865cf', '9adff3b1-7243-46a1-8e46-aa7614f87949', '811f581a-06bc-4f69-aeb5-ba9ab78f99bd'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:49:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9640a3fc-6d77-42eb-81f2-cabf9610438d tempest-VolumesSnapshotTestJSON-1655972575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9640a3fc-6d77-42eb-81f2-cabf9610438d tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9640a3fc-6d77-42eb-81f2-cabf9610438d tempest-VolumesSnapshotTestJSON-1655972575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:49:46 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9640a3fc-6d77-42eb-81f2-cabf9610438d tempest-VolumesSnapshotTestJSON-1655972575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:49:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9640a3fc-6d77-42eb-81f2-cabf9610438d tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9640a3fc-6d77-42eb-81f2-cabf9610438d tempest-VolumesSnapshotTestJSON-1655972575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:46 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:49:46 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:46 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9640a3fc-6d77-42eb-81f2-cabf9610438d tempest-VolumesSnapshotTestJSON-1655972575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.349s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:46 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-9640a3fc-6d77-42eb-81f2-cabf9610438d tempest-VolumesSnapshotTestJSON-1655972575 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:49:46 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-9640a3fc-6d77-42eb-81f2-cabf9610438d tempest-VolumesSnapshotTestJSON-1655972575 None] Deleted volume successfully. Sep 05 11:49:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9640a3fc-6d77-42eb-81f2-cabf9610438d tempest-VolumesSnapshotTestJSON-1655972575 None] Lock "cinder-0433c512-be81-4662-bea7-0bdf53d83108-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:49:50 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:49:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] Flow 'volume_create_manager' (ef859601-a70d-4537-9035-131339dcba53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:49:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7d9d539-e749-4122-8e4e-52c129c5ffbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7d9d539-e749-4122-8e4e-52c129c5ffbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1671043208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcc4d295-33e9-4577-9ab8-137bd9f680cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c64b7773297430fa51359b3d24ab363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:49:51Z,use_quota=True,user_id='af3ae67fb52c49e5bcbdb2d817d0f495',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb35af76-2979-443f-ab4c-51eac65d0f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb35af76-2979-443f-ab4c-51eac65d0f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e132d0b-9625-4802-83b9-780e39839225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e132d0b-9625-4802-83b9-780e39839225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcc4d295-33e9-4577-9ab8-137bd9f680cf', 'volume_name': 'volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55920da9-b1da-41dc-97e1-7364c0cd9a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55920da9-b1da-41dc-97e1-7364c0cd9a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a233c3-0172-4fdf-b9e3-3f56dcb0980b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:51 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] Volume dcc4d295-33e9-4577-9ab8-137bd9f680cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf', 'volume_size': 1} Sep 05 11:49:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1671043208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcc4d295-33e9-4577-9ab8-137bd9f680cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c64b7773297430fa51359b3d24ab363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:49:51Z,use_quota=True,user_id='af3ae67fb52c49e5bcbdb2d817d0f495',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:49:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] Creating volume dcc4d295-33e9-4577-9ab8-137bd9f680cf {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:49:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:49:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:49:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:49:51 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:49:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:51 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf 1073741824 Sep 05 11:49:51 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:51 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf 1073741824" returned: 0 in 0.540s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:51 devstack sudo[104435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf Sep 05 11:49:51 devstack sudo[104435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:51 devstack sudo[104435]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf" returned: 0 in 0.286s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:49:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a233c3-0172-4fdf-b9e3-3f56dcb0980b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f015d603-fa5c-4bb8-b284-237e3a9676cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:52 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] Volume volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf (dcc4d295-33e9-4577-9ab8-137bd9f680cf): created successfully Sep 05 11:49:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f015d603-fa5c-4bb8-b284-237e3a9676cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] Flow 'volume_create_manager' (ef859601-a70d-4537-9035-131339dcba53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:49:52 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-45a5022c-ddeb-4d34-be96-c90c6cfb3a8e tempest-SnapshotDependencyTests-442955466 None] Created volume successfully. Sep 05 11:49:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-be4943bb-2993-4ca6-b0e6-a5f81d282886 tempest-SnapshotDependencyTests-442955466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-be4943bb-2993-4ca6-b0e6-a5f81d282886 tempest-SnapshotDependencyTests-442955466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-be4943bb-2993-4ca6-b0e6-a5f81d282886 tempest-SnapshotDependencyTests-442955466 None] Creating offline snapshot a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788 of volume dcc4d295-33e9-4577-9ab8-137bd9f680cf {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:49:53 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f08bb7b-27c7-4b51-9d25-693aae92f4a4]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-be4943bb-2993-4ca6-b0e6-a5f81d282886 tempest-SnapshotDependencyTests-442955466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:53 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf Sep 05 11:49:53 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:53 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-be4943bb-2993-4ca6-b0e6-a5f81d282886 tempest-SnapshotDependencyTests-442955466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf" returned: 0 in 0.454s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-be4943bb-2993-4ca6-b0e6-a5f81d282886 tempest-SnapshotDependencyTests-442955466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf.a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:53 devstack sudo[104451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf.a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788 1G Sep 05 11:49:53 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:54 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-be4943bb-2993-4ca6-b0e6-a5f81d282886 tempest-SnapshotDependencyTests-442955466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf.a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788 1G" returned: 0 in 0.423s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-be4943bb-2993-4ca6-b0e6-a5f81d282886 tempest-SnapshotDependencyTests-442955466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf.a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:54 devstack sudo[104457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf.a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788 Sep 05 11:49:54 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:54 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-be4943bb-2993-4ca6-b0e6-a5f81d282886 tempest-SnapshotDependencyTests-442955466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf.a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788" returned: 0 in 0.314s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:54 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-be4943bb-2993-4ca6-b0e6-a5f81d282886 tempest-SnapshotDependencyTests-442955466 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf.a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788 is being set with open permissions: ugo+rw Sep 05 11:49:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-be4943bb-2993-4ca6-b0e6-a5f81d282886 tempest-SnapshotDependencyTests-442955466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf.a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:54 devstack sudo[104463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf.a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788 Sep 05 11:49:54 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:54 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-be4943bb-2993-4ca6-b0e6-a5f81d282886 tempest-SnapshotDependencyTests-442955466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf.a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788" returned: 0 in 0.265s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-be4943bb-2993-4ca6-b0e6-a5f81d282886 tempest-SnapshotDependencyTests-442955466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:54 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf.info Sep 05 11:49:54 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:55 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-be4943bb-2993-4ca6-b0e6-a5f81d282886 tempest-SnapshotDependencyTests-442955466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf.info" returned: 0 in 0.251s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:55 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-be4943bb-2993-4ca6-b0e6-a5f81d282886 tempest-SnapshotDependencyTests-442955466 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf.info is being set with open permissions: ugo+rw Sep 05 11:49:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-be4943bb-2993-4ca6-b0e6-a5f81d282886 tempest-SnapshotDependencyTests-442955466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:55 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf.info Sep 05 11:49:55 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:55 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-be4943bb-2993-4ca6-b0e6-a5f81d282886 tempest-SnapshotDependencyTests-442955466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf.info" returned: 0 in 0.268s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-be4943bb-2993-4ca6-b0e6-a5f81d282886 tempest-SnapshotDependencyTests-442955466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.069s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:55 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-be4943bb-2993-4ca6-b0e6-a5f81d282886 tempest-SnapshotDependencyTests-442955466 None] Create snapshot completed successfully Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Flow 'volume_create_manager' (20930d79-3124-4cf5-9a3c-98c4abe0687c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092b9f93-3e2a-46df-ba89-0edd734119d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092b9f93-3e2a-46df-ba89-0edd734119d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e40c84cd-22f9-4afd-be41-559be6ad5017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c64b7773297430fa51359b3d24ab363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:49:57Z,use_quota=True,user_id='af3ae67fb52c49e5bcbdb2d817d0f495',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e1b85e-24ff-4ba0-adf8-059e71b26860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e1b85e-24ff-4ba0-adf8-059e71b26860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f2a260f-b250-48c2-99a8-e9ea1f172ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f2a260f-b250-48c2-99a8-e9ea1f172ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e40c84cd-22f9-4afd-be41-559be6ad5017', 'volume_name': 'volume-e40c84cd-22f9-4afd-be41-559be6ad5017', 'volume_size': 1, 'snapshot_id': 'a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63f6a459-1859-4cee-a2a0-85b8cb61e648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63f6a459-1859-4cee-a2a0-85b8cb61e648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea62001-08d0-466b-b831-04d1fceb379a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:49:57 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Volume e40c84cd-22f9-4afd-be41-559be6ad5017: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e40c84cd-22f9-4afd-be41-559be6ad5017', 'volume_size': 1, 'snapshot_id': 'a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788'} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Acquiring lock "cinder-quobyte-a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788-e40c84cd-22f9-4afd-be41-559be6ad5017" by "_create_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Lock "cinder-quobyte-a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788-e40c84cd-22f9-4afd-be41-559be6ad5017" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Creating volume e40c84cd-22f9-4afd-be41-559be6ad5017 from snapshot a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788 {{(pid=87517) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Acquiring lock "cinder-quobyte-e40c84cd-22f9-4afd-be41-559be6ad5017" by "_copy_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Lock "cinder-quobyte-e40c84cd-22f9-4afd-be41-559be6ad5017" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] snapshot: a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788, volume: e40c84cd-22f9-4afd-be41-559be6ad5017, {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[df50a579-6ecd-4b14-a701-0858d6707eac]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf.a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:57 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf.a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788 Sep 05 11:49:57 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:57 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf.a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788" returned: 0 in 0.368s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[92664cd2-8171-4d94-b8fc-49e19e6ba67c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:49:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:57 devstack sudo[104477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf Sep 05 11:49:57 devstack sudo[104477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:49:58 devstack sudo[104477]: pam_unix(sudo:session): session closed for user root Sep 05 11:49:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf" returned: 0 in 0.375s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:49:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 11:49:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Creating direct copy from snapshot {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 11:49:58 devstack cinder-volume[87517]: DEBUG cinder.utils [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Path /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e40c84cd-22f9-4afd-be41-559be6ad5017 not found in is_blk_device check {{(pid=87517) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 11:49:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e40c84cd-22f9-4afd-be41-559be6ad5017 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:49:58 devstack sudo[104483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e40c84cd-22f9-4afd-be41-559be6ad5017 Sep 05 11:49:58 devstack sudo[104483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:00 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=135,cinder:INSERT=54,cinder:UPDATE=166,cinder:DELETE=9 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:50:00 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=135,cinder:UPDATE=158,cinder:DELETE=19,cinder:INSERT=35 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:50:00 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:50:00 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Flow 'volume_create_manager' (aa6d1c49-2500-40e1-92b1-922b14d1ddb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:50:00 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3502590-6116-45de-a9a5-7dba0f6a38d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:00 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3502590-6116-45de-a9a5-7dba0f6a38d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=464a1971-f392-49e4-be7c-7cf27594eb24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='208dff0f9c944771b767d8db4535d0e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:50:01Z,use_quota=True,user_id='48b3f5cb06d74a7aba02bc4d7d61d512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb730225-c7ac-4a63-ae0a-31bb915d100f),volume_type_id=fb730225-c7ac-4a63-ae0a-31bb915d100f)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:00 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74116786-9f6c-467a-966e-5e0789c342cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:00 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74116786-9f6c-467a-966e-5e0789c342cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:00 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5caec221-36a3-432a-bc23-a6abf8ccafed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:00 devstack cinder-volume[87517]: DEBUG cinder.image.glance [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Creating Keystone auth plugin from conf {{(pid=87517) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 11:50:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5caec221-36a3-432a-bc23-a6abf8ccafed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '464a1971-f392-49e4-be7c-7cf27594eb24', 'volume_name': 'volume-464a1971-f392-49e4-be7c-7cf27594eb24', 'volume_size': 1, 'image_id': '24cf220a-aaa8-4800-81ba-2a3fc21293bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24cf220a-aaa8-4800-81ba-2a3fc21293bd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6892cee8d054ab8cd285ecd4bdd9daab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '208dff0f9c944771b767d8db4535d0e5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '44740c6d8db5f5d260569e658590047987990b2e9927528e846ffc61ab4e98f1c251b20cb4f8d754e823c66de4d1f5c6dc18e65af83d92e82a91b6add0dc3c46', 'id': '24cf220a-aaa8-4800-81ba-2a3fc21293bd', 'created_at': datetime.datetime(2026, 9, 5, 9, 49, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 9, 49, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24cf220a-aaa8-4800-81ba-2a3fc21293bd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de0156a-4d51-4763-ba59-93707cb3f61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de0156a-4d51-4763-ba59-93707cb3f61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1efcbde2-ab9a-425c-b62b-71ad66ca5c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:01 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Volume 464a1971-f392-49e4-be7c-7cf27594eb24: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-464a1971-f392-49e4-be7c-7cf27594eb24', 'volume_size': 1, 'image_id': '24cf220a-aaa8-4800-81ba-2a3fc21293bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24cf220a-aaa8-4800-81ba-2a3fc21293bd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6892cee8d054ab8cd285ecd4bdd9daab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '208dff0f9c944771b767d8db4535d0e5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '44740c6d8db5f5d260569e658590047987990b2e9927528e846ffc61ab4e98f1c251b20cb4f8d754e823c66de4d1f5c6dc18e65af83d92e82a91b6add0dc3c46', 'id': '24cf220a-aaa8-4800-81ba-2a3fc21293bd', 'created_at': datetime.datetime(2026, 9, 5, 9, 49, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 9, 49, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24cf220a-aaa8-4800-81ba-2a3fc21293bd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 05 11:50:01 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Trying to clone 464a1971-f392-49e4-be7c-7cf27594eb24 from image 24cf220a-aaa8-4800-81ba-2a3fc21293bd at location (None, [{'url': 'file:///opt/stack/data/glance/images/24cf220a-aaa8-4800-81ba-2a3fc21293bd', 'metadata': {}}]). {{(pid=87517) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 11:50:01 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_24cf220a-aaa8-4800-81ba-2a3fc21293bd_4_759863devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 11:50:01 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Image download 0.00 MB at 0.00 MB/s Sep 05 11:50:01 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c15c52-7a8d-4b73-bc05-d765bccb7091]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:50:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf220a-aaa8-4800-81ba-2a3fc21293bd_4_759863devstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:01 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf220a-aaa8-4800-81ba-2a3fc21293bd_4_759863devstack@QuobyteHD Sep 05 11:50:01 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:02 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf220a-aaa8-4800-81ba-2a3fc21293bd_4_759863devstack@QuobyteHD" returned: 0 in 0.443s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf220a-aaa8-4800-81ba-2a3fc21293bd_4_759863devstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:02 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf220a-aaa8-4800-81ba-2a3fc21293bd_4_759863devstack@QuobyteHD Sep 05 11:50:02 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:02 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf220a-aaa8-4800-81ba-2a3fc21293bd_4_759863devstack@QuobyteHD" returned: 1 in 0.698s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf220a-aaa8-4800-81ba-2a3fc21293bd_4_759863devstack@QuobyteHD' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 11:50:02 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Temporary image 24cf220a-aaa8-4800-81ba-2a3fc21293bd is fetched for user 48b3f5cb06d74a7aba02bc4d7d61d512. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 11:50:02 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e24f5d-d25e-49e2-a161-23249777339d]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:50:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf220a-aaa8-4800-81ba-2a3fc21293bd_4_759863devstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:02 devstack sudo[104483]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e40c84cd-22f9-4afd-be41-559be6ad5017" returned: 0 in 4.942s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:02 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Image conversion details: src /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf, size 1024.00 MB, duration 4.94 sec, destination /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e40c84cd-22f9-4afd-be41-559be6ad5017 {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 11:50:02 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Converted 1024.00 MB image at 207.09 MB/s Sep 05 11:50:02 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e40c84cd-22f9-4afd-be41-559be6ad5017 is being set with open permissions: ugo+rw Sep 05 11:50:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e40c84cd-22f9-4afd-be41-559be6ad5017 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:03 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e40c84cd-22f9-4afd-be41-559be6ad5017 Sep 05 11:50:03 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:03 devstack sudo[104506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf220a-aaa8-4800-81ba-2a3fc21293bd_4_759863devstack@QuobyteHD Sep 05 11:50:03 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:03 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e40c84cd-22f9-4afd-be41-559be6ad5017" returned: 0 in 0.243s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Lock "cinder-quobyte-e40c84cd-22f9-4afd-be41-559be6ad5017" released by "_copy_volume_from_snapshot" :: held 6.012s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Lock "cinder-quobyte-a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788-e40c84cd-22f9-4afd-be41-559be6ad5017" released by "_create_volume_from_snapshot" :: held 6.081s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.098s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:03 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea62001-08d0-466b-b831-04d1fceb379a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e40c84cd-22f9-4afd-be41-559be6ad5017', 'volume_size': 1, 'snapshot_id': 'a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdf59aea-3971-4254-bd14-3a6b8d50658a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf220a-aaa8-4800-81ba-2a3fc21293bd_4_759863devstack@QuobyteHD" returned: 0 in 0.348s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf220a-aaa8-4800-81ba-2a3fc21293bd_4_759863devstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:03 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Volume volume-e40c84cd-22f9-4afd-be41-559be6ad5017 (e40c84cd-22f9-4afd-be41-559be6ad5017): created successfully Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdf59aea-3971-4254-bd14-3a6b8d50658a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Flow 'volume_create_manager' (20930d79-3124-4cf5-9a3c-98c4abe0687c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:50:03 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-14a67d0e-2b47-49e4-a80b-8c8e10321bbf tempest-SnapshotDependencyTests-442955466 None] Created volume successfully. Sep 05 11:50:03 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf220a-aaa8-4800-81ba-2a3fc21293bd_4_759863devstack@QuobyteHD Sep 05 11:50:03 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:03 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf220a-aaa8-4800-81ba-2a3fc21293bd_4_759863devstack@QuobyteHD" returned: 1 in 0.316s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf220a-aaa8-4800-81ba-2a3fc21293bd_4_759863devstack@QuobyteHD' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=464a1971-f392-49e4-be7c-7cf27594eb24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='208dff0f9c944771b767d8db4535d0e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:50:01Z,use_quota=True,user_id='48b3f5cb06d74a7aba02bc4d7d61d512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb730225-c7ac-4a63-ae0a-31bb915d100f),volume_type_id=fb730225-c7ac-4a63-ae0a-31bb915d100f)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Creating volume 464a1971-f392-49e4-be7c-7cf27594eb24 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:50:03 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-464a1971-f392-49e4-be7c-7cf27594eb24 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:03 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-464a1971-f392-49e4-be7c-7cf27594eb24 1073741824 Sep 05 11:50:03 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ca888289-7685-4fb6-82c0-d0d61b4ac320 tempest-SnapshotDependencyTests-442955466 None] Acquiring lock "cinder-a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ca888289-7685-4fb6-82c0-d0d61b4ac320 tempest-SnapshotDependencyTests-442955466 None] Lock "cinder-a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ca888289-7685-4fb6-82c0-d0d61b4ac320 tempest-SnapshotDependencyTests-442955466 None] Acquiring lock "cinder-quobyte-dcc4d295-33e9-4577-9ab8-137bd9f680cf" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ca888289-7685-4fb6-82c0-d0d61b4ac320 tempest-SnapshotDependencyTests-442955466 None] Lock "cinder-quobyte-dcc4d295-33e9-4577-9ab8-137bd9f680cf" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ca888289-7685-4fb6-82c0-d0d61b4ac320 tempest-SnapshotDependencyTests-442955466 None] Acquiring lock "cinder-quobyte-a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ca888289-7685-4fb6-82c0-d0d61b4ac320 tempest-SnapshotDependencyTests-442955466 None] Lock "cinder-quobyte-a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-ca888289-7685-4fb6-82c0-d0d61b4ac320 tempest-SnapshotDependencyTests-442955466 None] Deleting offline snapshot a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788 of volume dcc4d295-33e9-4577-9ab8-137bd9f680cf {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-ca888289-7685-4fb6-82c0-d0d61b4ac320 tempest-SnapshotDependencyTests-442955466 None] snapshot_file for this snap is: volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf.a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35ece0e-ed12-4eab-882b-f38f28877d7d]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:50:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca888289-7685-4fb6-82c0-d0d61b4ac320 tempest-SnapshotDependencyTests-442955466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf.a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:04 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf.a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788 Sep 05 11:50:04 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:04 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-464a1971-f392-49e4-be7c-7cf27594eb24 1073741824" returned: 0 in 0.426s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-464a1971-f392-49e4-be7c-7cf27594eb24 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:04 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-464a1971-f392-49e4-be7c-7cf27594eb24 Sep 05 11:50:04 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:04 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca888289-7685-4fb6-82c0-d0d61b4ac320 tempest-SnapshotDependencyTests-442955466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf.a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788" returned: 0 in 0.356s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-ca888289-7685-4fb6-82c0-d0d61b4ac320 tempest-SnapshotDependencyTests-442955466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:50:04 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceef11c8-9579-4a92-9b0d-e0841eb7687a]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:50:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca888289-7685-4fb6-82c0-d0d61b4ac320 tempest-SnapshotDependencyTests-442955466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:04 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-464a1971-f392-49e4-be7c-7cf27594eb24" returned: 0 in 0.263s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:50:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:04 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Attempting download of 24cf220a-aaa8-4800-81ba-2a3fc21293bd ((None, [{'url': 'file:///opt/stack/data/glance/images/24cf220a-aaa8-4800-81ba-2a3fc21293bd', 'metadata': {}}])) to volume 464a1971-f392-49e4-be7c-7cf27594eb24. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 11:50:04 devstack sudo[104532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf Sep 05 11:50:04 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:04 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e95c159-2777-4b8e-b78e-f56df378bf46]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:50:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24cf220a-aaa8-4800-81ba-2a3fc21293bd_drafgr6w {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:04 devstack sudo[104534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24cf220a-aaa8-4800-81ba-2a3fc21293bd_drafgr6w Sep 05 11:50:04 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:04 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24cf220a-aaa8-4800-81ba-2a3fc21293bd_drafgr6w" returned: 0 in 0.343s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24cf220a-aaa8-4800-81ba-2a3fc21293bd_drafgr6w {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:04 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca888289-7685-4fb6-82c0-d0d61b4ac320 tempest-SnapshotDependencyTests-442955466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf" returned: 0 in 0.562s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca888289-7685-4fb6-82c0-d0d61b4ac320 tempest-SnapshotDependencyTests-442955466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf.a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:04 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24cf220a-aaa8-4800-81ba-2a3fc21293bd_drafgr6w Sep 05 11:50:04 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:04 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf.a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788 Sep 05 11:50:04 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:05 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24cf220a-aaa8-4800-81ba-2a3fc21293bd_drafgr6w" returned: 1 in 0.324s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24cf220a-aaa8-4800-81ba-2a3fc21293bd_drafgr6w' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 11:50:05 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3adeb5-0d45-4004-b533-81134fff6196]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:50:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf220a-aaa8-4800-81ba-2a3fc21293bd_4_759863devstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:05 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca888289-7685-4fb6-82c0-d0d61b4ac320 tempest-SnapshotDependencyTests-442955466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf.a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788" returned: 0 in 0.327s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca888289-7685-4fb6-82c0-d0d61b4ac320 tempest-SnapshotDependencyTests-442955466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf.a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:05 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf220a-aaa8-4800-81ba-2a3fc21293bd_4_759863devstack@QuobyteHD Sep 05 11:50:05 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:05 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf.a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788 Sep 05 11:50:05 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:05 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf220a-aaa8-4800-81ba-2a3fc21293bd_4_759863devstack@QuobyteHD" returned: 0 in 0.319s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf220a-aaa8-4800-81ba-2a3fc21293bd_4_759863devstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:05 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca888289-7685-4fb6-82c0-d0d61b4ac320 tempest-SnapshotDependencyTests-442955466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf.a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788" returned: 0 in 0.263s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ca888289-7685-4fb6-82c0-d0d61b4ac320 tempest-SnapshotDependencyTests-442955466 None] Lock "cinder-quobyte-a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788" released by "_delete_snapshot" :: held 1.608s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:50:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ca888289-7685-4fb6-82c0-d0d61b4ac320 tempest-SnapshotDependencyTests-442955466 None] Lock "cinder-quobyte-dcc4d295-33e9-4577-9ab8-137bd9f680cf" released by "delete_snapshot" :: held 1.636s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:50:05 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf220a-aaa8-4800-81ba-2a3fc21293bd_4_759863devstack@QuobyteHD Sep 05 11:50:05 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:05 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-ca888289-7685-4fb6-82c0-d0d61b4ac320 tempest-SnapshotDependencyTests-442955466 None] Created reservations ['6e56123a-f9e8-482f-85da-c723bc1b1d1e', 'e78ef44b-22f0-4628-8c55-eb7eef924956', 'b992dab0-5c6f-4160-a115-652eacb1a732', '83d2eefb-1cdc-47fd-bb26-fafd5f1fc222'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:50:05 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ca888289-7685-4fb6-82c0-d0d61b4ac320 tempest-SnapshotDependencyTests-442955466 None] Delete snapshot completed successfully. Sep 05 11:50:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ca888289-7685-4fb6-82c0-d0d61b4ac320 tempest-SnapshotDependencyTests-442955466 None] Lock "cinder-a1da2b9b-dcd3-4fbb-8a6b-87ebd360b788-delete_snapshot" released by "delete_snapshot" :: held 1.770s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:50:05 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf220a-aaa8-4800-81ba-2a3fc21293bd_4_759863devstack@QuobyteHD" returned: 1 in 0.340s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf220a-aaa8-4800-81ba-2a3fc21293bd_4_759863devstack@QuobyteHD' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 11:50:05 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] 24cf220a-aaa8-4800-81ba-2a3fc21293bd was raw, converting to qcow2 {{(pid=87517) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 11:50:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_24cf220a-aaa8-4800-81ba-2a3fc21293bd_4_759863devstack@QuobyteHD /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-464a1971-f392-49e4-be7c-7cf27594eb24 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:05 devstack sudo[104562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_24cf220a-aaa8-4800-81ba-2a3fc21293bd_4_759863devstack@QuobyteHD /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-464a1971-f392-49e4-be7c-7cf27594eb24 Sep 05 11:50:05 devstack sudo[104562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ea54f402-61aa-420a-8ba0-37e788be8453 tempest-SnapshotDependencyTests-442955466 None] Acquiring lock "cinder-dcc4d295-33e9-4577-9ab8-137bd9f680cf-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:50:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ea54f402-61aa-420a-8ba0-37e788be8453 tempest-SnapshotDependencyTests-442955466 None] Lock "cinder-dcc4d295-33e9-4577-9ab8-137bd9f680cf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:50:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ea54f402-61aa-420a-8ba0-37e788be8453 tempest-SnapshotDependencyTests-442955466 None] Acquiring lock "cinder-quobyte-dcc4d295-33e9-4577-9ab8-137bd9f680cf" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:50:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ea54f402-61aa-420a-8ba0-37e788be8453 tempest-SnapshotDependencyTests-442955466 None] Lock "cinder-quobyte-dcc4d295-33e9-4577-9ab8-137bd9f680cf" acquired by "delete_volume" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:50:06 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c38ff41-bca3-4669-a4be-b790772b9e16]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:50:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ea54f402-61aa-420a-8ba0-37e788be8453 tempest-SnapshotDependencyTests-442955466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:06 devstack sudo[104562]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_24cf220a-aaa8-4800-81ba-2a3fc21293bd_4_759863devstack@QuobyteHD /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-464a1971-f392-49e4-be7c-7cf27594eb24" returned: 0 in 0.473s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:06 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_24cf220a-aaa8-4800-81ba-2a3fc21293bd_4_759863devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-464a1971-f392-49e4-be7c-7cf27594eb24 {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 11:50:06 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Converted 0.00 MB image at 0.00 MB/s Sep 05 11:50:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-464a1971-f392-49e4-be7c-7cf27594eb24 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:06 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf Sep 05 11:50:06 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:06 devstack sudo[104569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-464a1971-f392-49e4-be7c-7cf27594eb24 1G Sep 05 11:50:06 devstack sudo[104569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:06 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ea54f402-61aa-420a-8ba0-37e788be8453 tempest-SnapshotDependencyTests-442955466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf" returned: 0 in 0.367s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ea54f402-61aa-420a-8ba0-37e788be8453 tempest-SnapshotDependencyTests-442955466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:06 devstack sudo[104577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf Sep 05 11:50:06 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:06 devstack sudo[104569]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-464a1971-f392-49e4-be7c-7cf27594eb24 1G" returned: 0 in 0.305s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:06 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Downloaded image 24cf220a-aaa8-4800-81ba-2a3fc21293bd ((None, [{'url': 'file:///opt/stack/data/glance/images/24cf220a-aaa8-4800-81ba-2a3fc21293bd', 'metadata': {}}])) to volume 464a1971-f392-49e4-be7c-7cf27594eb24 successfully. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 11:50:06 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Temporary image 24cf220a-aaa8-4800-81ba-2a3fc21293bd for user 48b3f5cb06d74a7aba02bc4d7d61d512 is deleted. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 11:50:06 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Marking volume 464a1971-f392-49e4-be7c-7cf27594eb24 as bootable. {{(pid=87517) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 11:50:06 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Copying metadata from image 24cf220a-aaa8-4800-81ba-2a3fc21293bd to 464a1971-f392-49e4-be7c-7cf27594eb24. {{(pid=87517) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 11:50:06 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Creating volume glance metadata for volume 464a1971-f392-49e4-be7c-7cf27594eb24 backed by image 24cf220a-aaa8-4800-81ba-2a3fc21293bd with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '24cf220a-aaa8-4800-81ba-2a3fc21293bd', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '6892cee8d054ab8cd285ecd4bdd9daab', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87517) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 11:50:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1efcbde2-ab9a-425c-b62b-71ad66ca5c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-464a1971-f392-49e4-be7c-7cf27594eb24', 'volume_size': 1, 'image_id': '24cf220a-aaa8-4800-81ba-2a3fc21293bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24cf220a-aaa8-4800-81ba-2a3fc21293bd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6892cee8d054ab8cd285ecd4bdd9daab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '208dff0f9c944771b767d8db4535d0e5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '44740c6d8db5f5d260569e658590047987990b2e9927528e846ffc61ab4e98f1c251b20cb4f8d754e823c66de4d1f5c6dc18e65af83d92e82a91b6add0dc3c46', 'id': '24cf220a-aaa8-4800-81ba-2a3fc21293bd', 'created_at': datetime.datetime(2026, 9, 5, 9, 49, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 9, 49, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24cf220a-aaa8-4800-81ba-2a3fc21293bd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371bc1a7-52b0-40de-80d3-7e5e8a1ad452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:06 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Volume volume-464a1971-f392-49e4-be7c-7cf27594eb24 (464a1971-f392-49e4-be7c-7cf27594eb24): created successfully Sep 05 11:50:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371bc1a7-52b0-40de-80d3-7e5e8a1ad452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Flow 'volume_create_manager' (aa6d1c49-2500-40e1-92b1-922b14d1ddb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:50:06 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ca05b09f-965c-40cf-aa1f-f16c6fc6ac80 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Created volume successfully. Sep 05 11:50:06 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ea54f402-61aa-420a-8ba0-37e788be8453 tempest-SnapshotDependencyTests-442955466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-dcc4d295-33e9-4577-9ab8-137bd9f680cf" returned: 0 in 0.257s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ea54f402-61aa-420a-8ba0-37e788be8453 tempest-SnapshotDependencyTests-442955466 None] Lock "cinder-quobyte-dcc4d295-33e9-4577-9ab8-137bd9f680cf" released by "delete_volume" :: held 0.679s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:50:06 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-ea54f402-61aa-420a-8ba0-37e788be8453 tempest-SnapshotDependencyTests-442955466 None] Created reservations ['ad59c875-faa3-4bcd-903d-5a8ec310ed86', 'd4871d2b-77d0-41fb-aebf-02d934a449ab', 'cd77fa86-d28c-4652-8904-ca5edd7d930f', '0e8d17c5-21b0-4d92-bb2f-f43374ff98a2'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:50:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ea54f402-61aa-420a-8ba0-37e788be8453 tempest-SnapshotDependencyTests-442955466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:50:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ea54f402-61aa-420a-8ba0-37e788be8453 tempest-SnapshotDependencyTests-442955466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:50:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ea54f402-61aa-420a-8ba0-37e788be8453 tempest-SnapshotDependencyTests-442955466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:50:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ea54f402-61aa-420a-8ba0-37e788be8453 tempest-SnapshotDependencyTests-442955466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:50:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ea54f402-61aa-420a-8ba0-37e788be8453 tempest-SnapshotDependencyTests-442955466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ea54f402-61aa-420a-8ba0-37e788be8453 tempest-SnapshotDependencyTests-442955466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:06 devstack sudo[104581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:50:06 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-86ccbc04-a020-4170-9ff7-df51901899c4 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Acquiring lock "cinder-464a1971-f392-49e4-be7c-7cf27594eb24-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:50:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-86ccbc04-a020-4170-9ff7-df51901899c4 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Lock "cinder-464a1971-f392-49e4-be7c-7cf27594eb24-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:50:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-86ccbc04-a020-4170-9ff7-df51901899c4 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Acquiring lock "cinder-quobyte-464a1971-f392-49e4-be7c-7cf27594eb24" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:50:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-86ccbc04-a020-4170-9ff7-df51901899c4 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Lock "cinder-quobyte-464a1971-f392-49e4-be7c-7cf27594eb24" acquired by "delete_volume" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:50:07 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[00114969-c2bd-44eb-b272-a8c34cbd9f9a]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:50:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-86ccbc04-a020-4170-9ff7-df51901899c4 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-464a1971-f392-49e4-be7c-7cf27594eb24 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:07 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ea54f402-61aa-420a-8ba0-37e788be8453 tempest-SnapshotDependencyTests-442955466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.266s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:07 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-ea54f402-61aa-420a-8ba0-37e788be8453 tempest-SnapshotDependencyTests-442955466 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:50:07 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ea54f402-61aa-420a-8ba0-37e788be8453 tempest-SnapshotDependencyTests-442955466 None] Deleted volume successfully. Sep 05 11:50:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ea54f402-61aa-420a-8ba0-37e788be8453 tempest-SnapshotDependencyTests-442955466 None] Lock "cinder-dcc4d295-33e9-4577-9ab8-137bd9f680cf-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:50:07 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-464a1971-f392-49e4-be7c-7cf27594eb24 Sep 05 11:50:07 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5163d7a0-34fa-4247-ab65-4a206543150f tempest-SnapshotDependencyTests-442955466 None] Acquiring lock "cinder-e40c84cd-22f9-4afd-be41-559be6ad5017-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:50:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5163d7a0-34fa-4247-ab65-4a206543150f tempest-SnapshotDependencyTests-442955466 None] Lock "cinder-e40c84cd-22f9-4afd-be41-559be6ad5017-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:50:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5163d7a0-34fa-4247-ab65-4a206543150f tempest-SnapshotDependencyTests-442955466 None] Acquiring lock "cinder-quobyte-e40c84cd-22f9-4afd-be41-559be6ad5017" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:50:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5163d7a0-34fa-4247-ab65-4a206543150f tempest-SnapshotDependencyTests-442955466 None] Lock "cinder-quobyte-e40c84cd-22f9-4afd-be41-559be6ad5017" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:50:07 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a656a8f-689c-4e22-951b-4dee9bbda741]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:50:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5163d7a0-34fa-4247-ab65-4a206543150f tempest-SnapshotDependencyTests-442955466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e40c84cd-22f9-4afd-be41-559be6ad5017 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:07 devstack sudo[104586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e40c84cd-22f9-4afd-be41-559be6ad5017 Sep 05 11:50:07 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:07 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-86ccbc04-a020-4170-9ff7-df51901899c4 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-464a1971-f392-49e4-be7c-7cf27594eb24" returned: 0 in 0.397s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-86ccbc04-a020-4170-9ff7-df51901899c4 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-464a1971-f392-49e4-be7c-7cf27594eb24 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:07 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-464a1971-f392-49e4-be7c-7cf27594eb24 Sep 05 11:50:07 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:07 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5163d7a0-34fa-4247-ab65-4a206543150f tempest-SnapshotDependencyTests-442955466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e40c84cd-22f9-4afd-be41-559be6ad5017" returned: 0 in 0.364s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5163d7a0-34fa-4247-ab65-4a206543150f tempest-SnapshotDependencyTests-442955466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e40c84cd-22f9-4afd-be41-559be6ad5017 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:07 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e40c84cd-22f9-4afd-be41-559be6ad5017 Sep 05 11:50:07 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:07 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-86ccbc04-a020-4170-9ff7-df51901899c4 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-464a1971-f392-49e4-be7c-7cf27594eb24" returned: 0 in 0.265s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-86ccbc04-a020-4170-9ff7-df51901899c4 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Lock "cinder-quobyte-464a1971-f392-49e4-be7c-7cf27594eb24" released by "delete_volume" :: held 0.706s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:50:07 devstack cinder-volume[87517]: WARNING cinder.quota [None req-86ccbc04-a020-4170-9ff7-df51901899c4 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:50:07 devstack cinder-volume[87517]: WARNING cinder.quota [None req-86ccbc04-a020-4170-9ff7-df51901899c4 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 05 11:50:07 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-86ccbc04-a020-4170-9ff7-df51901899c4 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Created reservations ['357ec2be-c56f-4bac-8bce-778ac918da62', '3f3746ec-5951-4925-b56d-8706a37c2cee', 'a4ddcc9c-0e94-4fe3-8189-1b167bb52eb4', '7296b5b8-a888-4975-b466-04155c9d19f4'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:50:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-86ccbc04-a020-4170-9ff7-df51901899c4 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:50:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-86ccbc04-a020-4170-9ff7-df51901899c4 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:50:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-86ccbc04-a020-4170-9ff7-df51901899c4 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:50:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-86ccbc04-a020-4170-9ff7-df51901899c4 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:50:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-86ccbc04-a020-4170-9ff7-df51901899c4 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-86ccbc04-a020-4170-9ff7-df51901899c4 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:07 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:50:07 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:07 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5163d7a0-34fa-4247-ab65-4a206543150f tempest-SnapshotDependencyTests-442955466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e40c84cd-22f9-4afd-be41-559be6ad5017" returned: 0 in 0.247s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5163d7a0-34fa-4247-ab65-4a206543150f tempest-SnapshotDependencyTests-442955466 None] Lock "cinder-quobyte-e40c84cd-22f9-4afd-be41-559be6ad5017" released by "delete_volume" :: held 0.653s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:50:07 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-5163d7a0-34fa-4247-ab65-4a206543150f tempest-SnapshotDependencyTests-442955466 None] Created reservations ['a16b0a5d-309e-4a9b-ae52-99ce6c425e9a', 'f8922e9a-b873-455f-9ac3-c71d386cea13', 'e6fcd4dd-80c5-4877-b051-c446a8f061c9', '9715f19f-0283-449d-bed9-d4e6456d63f3'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:50:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5163d7a0-34fa-4247-ab65-4a206543150f tempest-SnapshotDependencyTests-442955466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:50:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5163d7a0-34fa-4247-ab65-4a206543150f tempest-SnapshotDependencyTests-442955466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:50:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5163d7a0-34fa-4247-ab65-4a206543150f tempest-SnapshotDependencyTests-442955466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:50:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5163d7a0-34fa-4247-ab65-4a206543150f tempest-SnapshotDependencyTests-442955466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:50:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5163d7a0-34fa-4247-ab65-4a206543150f tempest-SnapshotDependencyTests-442955466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5163d7a0-34fa-4247-ab65-4a206543150f tempest-SnapshotDependencyTests-442955466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:08 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:50:08 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:08 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-86ccbc04-a020-4170-9ff7-df51901899c4 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.247s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:08 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-86ccbc04-a020-4170-9ff7-df51901899c4 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:50:08 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-86ccbc04-a020-4170-9ff7-df51901899c4 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Deleted volume successfully. Sep 05 11:50:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-86ccbc04-a020-4170-9ff7-df51901899c4 tempest-VolumeAndVolumeTypeFromImageTest-320235271 None] Lock "cinder-464a1971-f392-49e4-be7c-7cf27594eb24-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:50:08 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5163d7a0-34fa-4247-ab65-4a206543150f tempest-SnapshotDependencyTests-442955466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.277s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:08 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-5163d7a0-34fa-4247-ab65-4a206543150f tempest-SnapshotDependencyTests-442955466 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:50:08 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-5163d7a0-34fa-4247-ab65-4a206543150f tempest-SnapshotDependencyTests-442955466 None] Deleted volume successfully. Sep 05 11:50:08 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5163d7a0-34fa-4247-ab65-4a206543150f tempest-SnapshotDependencyTests-442955466 None] Lock "cinder-e40c84cd-22f9-4afd-be41-559be6ad5017-delete_volume" released by "delete_volume" :: held 1.118s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:50:12 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:50:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Flow 'volume_create_manager' (d4078d78-9310-4c0e-bfc9-e8c4c3aac222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:50:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (586d6dd7-f879-4dd0-8134-e9373f17a3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (586d6dd7-f879-4dd0-8134-e9373f17a3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-550744499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=283592fb-ea1b-4a5b-935d-f085a33b0224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6404400e6c461da6cf5d7acddc0918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:50:13Z,use_quota=True,user_id='cce95d59eccb4818a62e5765927cc652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3b43718-f1c5-4caa-aef6-692d87c7a7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3b43718-f1c5-4caa-aef6-692d87c7a7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf5358f-0a67-46e0-9df0-98ed9fc0b2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf5358f-0a67-46e0-9df0-98ed9fc0b2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '283592fb-ea1b-4a5b-935d-f085a33b0224', 'volume_name': 'volume-283592fb-ea1b-4a5b-935d-f085a33b0224', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f4b747b-e7e1-4874-a867-7a5cefe1f1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f4b747b-e7e1-4874-a867-7a5cefe1f1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060e3c34-5f4b-431e-9f04-68b81357576b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:12 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Volume 283592fb-ea1b-4a5b-935d-f085a33b0224: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-283592fb-ea1b-4a5b-935d-f085a33b0224', 'volume_size': 1} Sep 05 11:50:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:50:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:50:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-550744499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=283592fb-ea1b-4a5b-935d-f085a33b0224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6404400e6c461da6cf5d7acddc0918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:50:13Z,use_quota=True,user_id='cce95d59eccb4818a62e5765927cc652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:50:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Creating volume 283592fb-ea1b-4a5b-935d-f085a33b0224 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:50:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:50:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:50:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:50:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:50:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:50:12 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:50:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-283592fb-ea1b-4a5b-935d-f085a33b0224 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:12 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-283592fb-ea1b-4a5b-935d-f085a33b0224 1073741824 Sep 05 11:50:12 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:13 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-283592fb-ea1b-4a5b-935d-f085a33b0224 1073741824" returned: 0 in 0.445s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-283592fb-ea1b-4a5b-935d-f085a33b0224 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:13 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-283592fb-ea1b-4a5b-935d-f085a33b0224 Sep 05 11:50:13 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:13 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-283592fb-ea1b-4a5b-935d-f085a33b0224" returned: 0 in 0.243s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:50:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060e3c34-5f4b-431e-9f04-68b81357576b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-283592fb-ea1b-4a5b-935d-f085a33b0224', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52f3683f-1f34-47e3-8e41-3820e237905f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:13 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Volume volume-283592fb-ea1b-4a5b-935d-f085a33b0224 (283592fb-ea1b-4a5b-935d-f085a33b0224): created successfully Sep 05 11:50:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52f3683f-1f34-47e3-8e41-3820e237905f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Flow 'volume_create_manager' (d4078d78-9310-4c0e-bfc9-e8c4c3aac222) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:50:13 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-1ac1cc6b-c961-4414-8bf6-c160ad8b6a19 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Created volume successfully. Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Flow 'volume_create_manager' (1002fe58-0c5e-40d1-be64-d8e829bb0f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd269bc7-ac82-4623-a41f-94f0bc0b5ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd269bc7-ac82-4623-a41f-94f0bc0b5ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-50624974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a783d7-0b18-4748-9955-15c7bb6bfd2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6404400e6c461da6cf5d7acddc0918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:50:14Z,use_quota=True,user_id='cce95d59eccb4818a62e5765927cc652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88d58077-6cb9-465c-91e2-e4e8db09b768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88d58077-6cb9-465c-91e2-e4e8db09b768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd1f430b-24b7-48d0-ba6e-a28cb6c52c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd1f430b-24b7-48d0-ba6e-a28cb6c52c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8a783d7-0b18-4748-9955-15c7bb6bfd2d', 'volume_name': 'volume-c8a783d7-0b18-4748-9955-15c7bb6bfd2d', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (501dab2f-f585-4f08-97a7-ce586c00fcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (501dab2f-f585-4f08-97a7-ce586c00fcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (407ff8bd-616b-473e-9420-a3b54bd8f185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:14 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Volume c8a783d7-0b18-4748-9955-15c7bb6bfd2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8a783d7-0b18-4748-9955-15c7bb6bfd2d', 'volume_size': 1} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-50624974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a783d7-0b18-4748-9955-15c7bb6bfd2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6404400e6c461da6cf5d7acddc0918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:50:14Z,use_quota=True,user_id='cce95d59eccb4818a62e5765927cc652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Creating volume c8a783d7-0b18-4748-9955-15c7bb6bfd2d {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:50:14 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c8a783d7-0b18-4748-9955-15c7bb6bfd2d 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:14 devstack sudo[104622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c8a783d7-0b18-4748-9955-15c7bb6bfd2d 1073741824 Sep 05 11:50:14 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Flow 'volume_create_manager' (6c158cc5-6b5b-4c8b-8e79-b33d8296633f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f694d3d-17ca-49e0-ba88-2ecc78d0b010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f694d3d-17ca-49e0-ba88-2ecc78d0b010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-161009190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d64c9bc-e60b-42d0-9c7d-913fbf2e84d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6404400e6c461da6cf5d7acddc0918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:50:14Z,use_quota=True,user_id='cce95d59eccb4818a62e5765927cc652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (622fbf48-b8db-49a3-96ad-a450f7b6fb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (622fbf48-b8db-49a3-96ad-a450f7b6fb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98687576-b3a9-42b6-91bd-be49da45f3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98687576-b3a9-42b6-91bd-be49da45f3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d64c9bc-e60b-42d0-9c7d-913fbf2e84d1', 'volume_name': 'volume-4d64c9bc-e60b-42d0-9c7d-913fbf2e84d1', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (394a82a4-0ca0-44f5-b7ea-55717a754f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (394a82a4-0ca0-44f5-b7ea-55717a754f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3353d27b-3c37-4fa1-9887-178d00e0b025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:14 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Volume 4d64c9bc-e60b-42d0-9c7d-913fbf2e84d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d64c9bc-e60b-42d0-9c7d-913fbf2e84d1', 'volume_size': 1} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:50:14 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c8a783d7-0b18-4748-9955-15c7bb6bfd2d 1073741824" returned: 0 in 0.589s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c8a783d7-0b18-4748-9955-15c7bb6bfd2d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:14 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c8a783d7-0b18-4748-9955-15c7bb6bfd2d Sep 05 11:50:14 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Flow 'volume_create_manager' (00e3fae3-b7cd-4dff-b9d1-c2bf1fef0ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3521512e-0ed4-4ca4-b7da-454bcb155dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3521512e-0ed4-4ca4-b7da-454bcb155dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1945598547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e12a5fac-6db2-407b-b12f-70aef6c9a752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6404400e6c461da6cf5d7acddc0918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:50:15Z,use_quota=True,user_id='cce95d59eccb4818a62e5765927cc652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae016ad1-beca-4f44-8494-ef18fffd48d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae016ad1-beca-4f44-8494-ef18fffd48d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a92af807-092f-4ed9-9cc0-334547f83bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a92af807-092f-4ed9-9cc0-334547f83bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e12a5fac-6db2-407b-b12f-70aef6c9a752', 'volume_name': 'volume-e12a5fac-6db2-407b-b12f-70aef6c9a752', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92a9f53-9049-47f7-806e-93a818016c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92a9f53-9049-47f7-806e-93a818016c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06563bb5-5d75-4895-baff-1b0ff6066efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:14 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Volume e12a5fac-6db2-407b-b12f-70aef6c9a752: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e12a5fac-6db2-407b-b12f-70aef6c9a752', 'volume_size': 1} Sep 05 11:50:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:50:15 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c8a783d7-0b18-4748-9955-15c7bb6bfd2d" returned: 0 in 0.329s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.533s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-161009190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d64c9bc-e60b-42d0-9c7d-913fbf2e84d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6404400e6c461da6cf5d7acddc0918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:50:14Z,use_quota=True,user_id='cce95d59eccb4818a62e5765927cc652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Creating volume 4d64c9bc-e60b-42d0-9c7d-913fbf2e84d1 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:50:15 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4d64c9bc-e60b-42d0-9c7d-913fbf2e84d1 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (407ff8bd-616b-473e-9420-a3b54bd8f185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8a783d7-0b18-4748-9955-15c7bb6bfd2d', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a937cec-25c3-4c9d-b32f-01a126f77bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:15 devstack sudo[104631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4d64c9bc-e60b-42d0-9c7d-913fbf2e84d1 1073741824 Sep 05 11:50:15 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:15 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Volume volume-c8a783d7-0b18-4748-9955-15c7bb6bfd2d (c8a783d7-0b18-4748-9955-15c7bb6bfd2d): created successfully Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a937cec-25c3-4c9d-b32f-01a126f77bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Flow 'volume_create_manager' (1002fe58-0c5e-40d1-be64-d8e829bb0f53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:50:15 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-4d936394-e85a-48c1-aacc-56301464b294 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Created volume successfully. Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Flow 'volume_create_manager' (8cdd6e13-0d63-48ae-ade3-c50d18e732b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (039aa69e-9e91-4558-8c9a-bcc7e6076c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (039aa69e-9e91-4558-8c9a-bcc7e6076c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-14516074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=455b4fe6-e923-4c19-8c34-202df7cac5e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6404400e6c461da6cf5d7acddc0918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:50:15Z,use_quota=True,user_id='cce95d59eccb4818a62e5765927cc652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c2cb69-ee50-4b7a-a032-36fa350726ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c2cb69-ee50-4b7a-a032-36fa350726ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (154f0132-e7e6-4dc7-937f-113746221144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (154f0132-e7e6-4dc7-937f-113746221144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '455b4fe6-e923-4c19-8c34-202df7cac5e9', 'volume_name': 'volume-455b4fe6-e923-4c19-8c34-202df7cac5e9', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc8c382-fdbf-4ea5-aa18-110e0cfe6792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc8c382-fdbf-4ea5-aa18-110e0cfe6792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (534d4846-47f7-4911-a42b-8998c6afc819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:15 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Volume 455b4fe6-e923-4c19-8c34-202df7cac5e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-455b4fe6-e923-4c19-8c34-202df7cac5e9', 'volume_size': 1} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:50:15 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4d64c9bc-e60b-42d0-9c7d-913fbf2e84d1 1073741824" returned: 0 in 0.624s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4d64c9bc-e60b-42d0-9c7d-913fbf2e84d1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:50:15 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4d64c9bc-e60b-42d0-9c7d-913fbf2e84d1 Sep 05 11:50:15 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Flow 'volume_create_manager' (30e0b2db-d421-4899-a6b2-c491acd39f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1903ab8-1961-45cb-b4c8-cd9085f8d3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1903ab8-1961-45cb-b4c8-cd9085f8d3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-88964993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ed031d4-2ae9-4435-81be-0550edd0d017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6404400e6c461da6cf5d7acddc0918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:50:16Z,use_quota=True,user_id='cce95d59eccb4818a62e5765927cc652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faeee355-fb56-4428-beb5-a31287938d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faeee355-fb56-4428-beb5-a31287938d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f01862b-e4af-4a1f-8e7a-2785957130ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f01862b-e4af-4a1f-8e7a-2785957130ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ed031d4-2ae9-4435-81be-0550edd0d017', 'volume_name': 'volume-5ed031d4-2ae9-4435-81be-0550edd0d017', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8b3d2c6-0209-483e-aed4-3d9288d2c199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8b3d2c6-0209-483e-aed4-3d9288d2c199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c46084ac-3674-4937-902a-ed647c3774b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:15 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Volume 5ed031d4-2ae9-4435-81be-0550edd0d017: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ed031d4-2ae9-4435-81be-0550edd0d017', 'volume_size': 1} Sep 05 11:50:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:50:16 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4d64c9bc-e60b-42d0-9c7d-913fbf2e84d1" returned: 0 in 0.243s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.073s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1945598547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e12a5fac-6db2-407b-b12f-70aef6c9a752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6404400e6c461da6cf5d7acddc0918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:50:15Z,use_quota=True,user_id='cce95d59eccb4818a62e5765927cc652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Creating volume e12a5fac-6db2-407b-b12f-70aef6c9a752 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:50:16 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e12a5fac-6db2-407b-b12f-70aef6c9a752 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3353d27b-3c37-4fa1-9887-178d00e0b025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d64c9bc-e60b-42d0-9c7d-913fbf2e84d1', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c850f38d-1c53-4c13-932c-22cf49f2e0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:16 devstack sudo[104641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e12a5fac-6db2-407b-b12f-70aef6c9a752 1073741824 Sep 05 11:50:16 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:16 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Volume volume-4d64c9bc-e60b-42d0-9c7d-913fbf2e84d1 (4d64c9bc-e60b-42d0-9c7d-913fbf2e84d1): created successfully Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c850f38d-1c53-4c13-932c-22cf49f2e0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Flow 'volume_create_manager' (6c158cc5-6b5b-4c8b-8e79-b33d8296633f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:50:16 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ac915ce7-7cfa-400c-9b94-882b389262c7 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Created volume successfully. Sep 05 11:50:16 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e12a5fac-6db2-407b-b12f-70aef6c9a752 1073741824" returned: 0 in 0.426s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e12a5fac-6db2-407b-b12f-70aef6c9a752 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:16 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e12a5fac-6db2-407b-b12f-70aef6c9a752 Sep 05 11:50:16 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:16 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e12a5fac-6db2-407b-b12f-70aef6c9a752" returned: 0 in 0.297s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.438s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-14516074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=455b4fe6-e923-4c19-8c34-202df7cac5e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6404400e6c461da6cf5d7acddc0918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:50:15Z,use_quota=True,user_id='cce95d59eccb4818a62e5765927cc652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Creating volume 455b4fe6-e923-4c19-8c34-202df7cac5e9 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:50:16 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-455b4fe6-e923-4c19-8c34-202df7cac5e9 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06563bb5-5d75-4895-baff-1b0ff6066efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e12a5fac-6db2-407b-b12f-70aef6c9a752', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:16 devstack sudo[104650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-455b4fe6-e923-4c19-8c34-202df7cac5e9 1073741824 Sep 05 11:50:16 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f0f17ae-6b12-4854-9979-1c52ed05b005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:16 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Volume volume-e12a5fac-6db2-407b-b12f-70aef6c9a752 (e12a5fac-6db2-407b-b12f-70aef6c9a752): created successfully Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f0f17ae-6b12-4854-9979-1c52ed05b005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Flow 'volume_create_manager' (00e3fae3-b7cd-4dff-b9d1-c2bf1fef0ed8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:50:16 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6bd954d1-35ec-4d6c-a20f-5f6d2e0ef05d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Created volume successfully. Sep 05 11:50:17 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-455b4fe6-e923-4c19-8c34-202df7cac5e9 1073741824" returned: 0 in 0.476s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-455b4fe6-e923-4c19-8c34-202df7cac5e9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:17 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-455b4fe6-e923-4c19-8c34-202df7cac5e9 Sep 05 11:50:17 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:17 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-455b4fe6-e923-4c19-8c34-202df7cac5e9" returned: 0 in 0.252s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:50:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.732s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:50:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-88964993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ed031d4-2ae9-4435-81be-0550edd0d017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6404400e6c461da6cf5d7acddc0918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:50:16Z,use_quota=True,user_id='cce95d59eccb4818a62e5765927cc652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:50:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Creating volume 5ed031d4-2ae9-4435-81be-0550edd0d017 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:50:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:50:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:50:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:50:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:50:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:50:17 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:50:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5ed031d4-2ae9-4435-81be-0550edd0d017 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:17 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5ed031d4-2ae9-4435-81be-0550edd0d017 1073741824 Sep 05 11:50:17 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (534d4846-47f7-4911-a42b-8998c6afc819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-455b4fe6-e923-4c19-8c34-202df7cac5e9', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf7ed882-a009-4cad-9160-0c15245f6625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:17 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Volume volume-455b4fe6-e923-4c19-8c34-202df7cac5e9 (455b4fe6-e923-4c19-8c34-202df7cac5e9): created successfully Sep 05 11:50:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf7ed882-a009-4cad-9160-0c15245f6625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Flow 'volume_create_manager' (8cdd6e13-0d63-48ae-ade3-c50d18e732b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:50:17 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7b9de87e-b887-42ef-ad67-8b0d904b97f0 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Created volume successfully. Sep 05 11:50:18 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5ed031d4-2ae9-4435-81be-0550edd0d017 1073741824" returned: 0 in 0.484s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5ed031d4-2ae9-4435-81be-0550edd0d017 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:18 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5ed031d4-2ae9-4435-81be-0550edd0d017 Sep 05 11:50:18 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:18 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5ed031d4-2ae9-4435-81be-0550edd0d017" returned: 0 in 0.255s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:50:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c46084ac-3674-4937-902a-ed647c3774b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ed031d4-2ae9-4435-81be-0550edd0d017', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faac8fa6-0c67-4207-a0b3-208e269fe12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:18 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Volume volume-5ed031d4-2ae9-4435-81be-0550edd0d017 (5ed031d4-2ae9-4435-81be-0550edd0d017): created successfully Sep 05 11:50:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faac8fa6-0c67-4207-a0b3-208e269fe12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Flow 'volume_create_manager' (30e0b2db-d421-4899-a6b2-c491acd39f66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:50:18 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3a53cb88-008d-4d2b-8f1e-2233c9a47e4d tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Created volume successfully. Sep 05 11:50:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1a0faa6b-482b-4272-be8a-e12df2fab177 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Acquiring lock "cinder-5ed031d4-2ae9-4435-81be-0550edd0d017-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:50:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1a0faa6b-482b-4272-be8a-e12df2fab177 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "cinder-5ed031d4-2ae9-4435-81be-0550edd0d017-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:50:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1a0faa6b-482b-4272-be8a-e12df2fab177 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Acquiring lock "cinder-quobyte-5ed031d4-2ae9-4435-81be-0550edd0d017" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:50:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1a0faa6b-482b-4272-be8a-e12df2fab177 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "cinder-quobyte-5ed031d4-2ae9-4435-81be-0550edd0d017" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:50:19 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[58693327-cf0f-4ab7-ba96-4b482e347442]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:50:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1a0faa6b-482b-4272-be8a-e12df2fab177 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5ed031d4-2ae9-4435-81be-0550edd0d017 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:19 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5ed031d4-2ae9-4435-81be-0550edd0d017 Sep 05 11:50:19 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:19 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1a0faa6b-482b-4272-be8a-e12df2fab177 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5ed031d4-2ae9-4435-81be-0550edd0d017" returned: 0 in 0.364s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1a0faa6b-482b-4272-be8a-e12df2fab177 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5ed031d4-2ae9-4435-81be-0550edd0d017 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:19 devstack sudo[104674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5ed031d4-2ae9-4435-81be-0550edd0d017 Sep 05 11:50:19 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:19 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1a0faa6b-482b-4272-be8a-e12df2fab177 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5ed031d4-2ae9-4435-81be-0550edd0d017" returned: 0 in 0.237s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1a0faa6b-482b-4272-be8a-e12df2fab177 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "cinder-quobyte-5ed031d4-2ae9-4435-81be-0550edd0d017" released by "delete_volume" :: held 0.640s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:50:19 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-1a0faa6b-482b-4272-be8a-e12df2fab177 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Created reservations ['9bb36290-98f7-43d7-8795-c16770c9e428', '150e4225-41b7-4dac-88d6-1b4e7374477b', '92b369cb-7969-4d47-9552-7961cab72e15', 'ff31dd2d-e4b8-44f0-aafd-b5d95178cb04'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:50:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1a0faa6b-482b-4272-be8a-e12df2fab177 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:50:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1a0faa6b-482b-4272-be8a-e12df2fab177 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:50:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1a0faa6b-482b-4272-be8a-e12df2fab177 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:50:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-1a0faa6b-482b-4272-be8a-e12df2fab177 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:50:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-1a0faa6b-482b-4272-be8a-e12df2fab177 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1a0faa6b-482b-4272-be8a-e12df2fab177 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:20 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:50:20 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:20 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-1a0faa6b-482b-4272-be8a-e12df2fab177 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.232s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:20 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-1a0faa6b-482b-4272-be8a-e12df2fab177 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:50:20 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-1a0faa6b-482b-4272-be8a-e12df2fab177 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Deleted volume successfully. Sep 05 11:50:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-1a0faa6b-482b-4272-be8a-e12df2fab177 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "cinder-5ed031d4-2ae9-4435-81be-0550edd0d017-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:50:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-02bdd000-14d4-4abb-8cb7-52da8e6908d3 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Acquiring lock "cinder-455b4fe6-e923-4c19-8c34-202df7cac5e9-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:50:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-02bdd000-14d4-4abb-8cb7-52da8e6908d3 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "cinder-455b4fe6-e923-4c19-8c34-202df7cac5e9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:50:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-02bdd000-14d4-4abb-8cb7-52da8e6908d3 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Acquiring lock "cinder-quobyte-455b4fe6-e923-4c19-8c34-202df7cac5e9" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:50:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-02bdd000-14d4-4abb-8cb7-52da8e6908d3 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "cinder-quobyte-455b4fe6-e923-4c19-8c34-202df7cac5e9" acquired by "delete_volume" :: waited 0.013s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:50:20 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d325a3eb-17de-406f-996c-939dc2d45925]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:50:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-02bdd000-14d4-4abb-8cb7-52da8e6908d3 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-455b4fe6-e923-4c19-8c34-202df7cac5e9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:20 devstack sudo[104680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-455b4fe6-e923-4c19-8c34-202df7cac5e9 Sep 05 11:50:20 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:20 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-02bdd000-14d4-4abb-8cb7-52da8e6908d3 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-455b4fe6-e923-4c19-8c34-202df7cac5e9" returned: 0 in 0.355s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-02bdd000-14d4-4abb-8cb7-52da8e6908d3 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-455b4fe6-e923-4c19-8c34-202df7cac5e9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:20 devstack sudo[104685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-455b4fe6-e923-4c19-8c34-202df7cac5e9 Sep 05 11:50:20 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:21 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-02bdd000-14d4-4abb-8cb7-52da8e6908d3 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-455b4fe6-e923-4c19-8c34-202df7cac5e9" returned: 0 in 0.241s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-02bdd000-14d4-4abb-8cb7-52da8e6908d3 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "cinder-quobyte-455b4fe6-e923-4c19-8c34-202df7cac5e9" released by "delete_volume" :: held 0.631s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:50:21 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-02bdd000-14d4-4abb-8cb7-52da8e6908d3 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Created reservations ['fae0e233-e2c7-4af3-a93d-d5703a0e21bb', '28ff4c53-b1df-40ba-9efc-d3cb05790d60', '45bb5ea5-8d13-4106-a839-a25d483823bc', '7ff1275b-4294-4628-885b-cc0b6ba539d7'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:50:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-02bdd000-14d4-4abb-8cb7-52da8e6908d3 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:50:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-02bdd000-14d4-4abb-8cb7-52da8e6908d3 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:50:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-02bdd000-14d4-4abb-8cb7-52da8e6908d3 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:50:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-02bdd000-14d4-4abb-8cb7-52da8e6908d3 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:50:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-02bdd000-14d4-4abb-8cb7-52da8e6908d3 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-02bdd000-14d4-4abb-8cb7-52da8e6908d3 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:21 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:50:21 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:21 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-02bdd000-14d4-4abb-8cb7-52da8e6908d3 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.253s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:21 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-02bdd000-14d4-4abb-8cb7-52da8e6908d3 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:50:21 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-02bdd000-14d4-4abb-8cb7-52da8e6908d3 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Deleted volume successfully. Sep 05 11:50:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-02bdd000-14d4-4abb-8cb7-52da8e6908d3 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "cinder-455b4fe6-e923-4c19-8c34-202df7cac5e9-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:50:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8a69845a-b83f-41bb-b3f4-2dd54c6d345f tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Acquiring lock "cinder-e12a5fac-6db2-407b-b12f-70aef6c9a752-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:50:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8a69845a-b83f-41bb-b3f4-2dd54c6d345f tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "cinder-e12a5fac-6db2-407b-b12f-70aef6c9a752-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:50:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8a69845a-b83f-41bb-b3f4-2dd54c6d345f tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Acquiring lock "cinder-quobyte-e12a5fac-6db2-407b-b12f-70aef6c9a752" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:50:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8a69845a-b83f-41bb-b3f4-2dd54c6d345f tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "cinder-quobyte-e12a5fac-6db2-407b-b12f-70aef6c9a752" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:50:21 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[69594f5c-3c96-449c-afe0-61c1503b7f65]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:50:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8a69845a-b83f-41bb-b3f4-2dd54c6d345f tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e12a5fac-6db2-407b-b12f-70aef6c9a752 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:21 devstack sudo[104692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e12a5fac-6db2-407b-b12f-70aef6c9a752 Sep 05 11:50:21 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:21 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8a69845a-b83f-41bb-b3f4-2dd54c6d345f tempest-CreateVolumesFromSourceVolumeTest-815457447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e12a5fac-6db2-407b-b12f-70aef6c9a752" returned: 0 in 0.346s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8a69845a-b83f-41bb-b3f4-2dd54c6d345f tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e12a5fac-6db2-407b-b12f-70aef6c9a752 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:21 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e12a5fac-6db2-407b-b12f-70aef6c9a752 Sep 05 11:50:21 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:22 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8a69845a-b83f-41bb-b3f4-2dd54c6d345f tempest-CreateVolumesFromSourceVolumeTest-815457447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e12a5fac-6db2-407b-b12f-70aef6c9a752" returned: 0 in 0.236s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8a69845a-b83f-41bb-b3f4-2dd54c6d345f tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "cinder-quobyte-e12a5fac-6db2-407b-b12f-70aef6c9a752" released by "delete_volume" :: held 0.624s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:50:22 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-8a69845a-b83f-41bb-b3f4-2dd54c6d345f tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Created reservations ['02715e2d-0812-4ea0-9783-e312305aac2b', 'c437e83f-20e5-459a-872b-0380ca7b7584', '1dd50426-6a01-45f1-9eef-e565fd4a19cd', '4659bf5c-0347-475d-b301-801b8175ed63'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:50:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8a69845a-b83f-41bb-b3f4-2dd54c6d345f tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:50:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8a69845a-b83f-41bb-b3f4-2dd54c6d345f tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:50:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8a69845a-b83f-41bb-b3f4-2dd54c6d345f tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:50:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8a69845a-b83f-41bb-b3f4-2dd54c6d345f tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:50:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8a69845a-b83f-41bb-b3f4-2dd54c6d345f tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8a69845a-b83f-41bb-b3f4-2dd54c6d345f tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:22 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:50:22 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:22 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8a69845a-b83f-41bb-b3f4-2dd54c6d345f tempest-CreateVolumesFromSourceVolumeTest-815457447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.236s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:22 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-8a69845a-b83f-41bb-b3f4-2dd54c6d345f tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:50:22 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-8a69845a-b83f-41bb-b3f4-2dd54c6d345f tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Deleted volume successfully. Sep 05 11:50:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8a69845a-b83f-41bb-b3f4-2dd54c6d345f tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "cinder-e12a5fac-6db2-407b-b12f-70aef6c9a752-delete_volume" released by "delete_volume" :: held 1.043s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:50:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3ab69ad2-deff-4133-85c5-731c96ca44a5 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Acquiring lock "cinder-4d64c9bc-e60b-42d0-9c7d-913fbf2e84d1-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:50:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3ab69ad2-deff-4133-85c5-731c96ca44a5 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "cinder-4d64c9bc-e60b-42d0-9c7d-913fbf2e84d1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:50:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3ab69ad2-deff-4133-85c5-731c96ca44a5 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Acquiring lock "cinder-quobyte-4d64c9bc-e60b-42d0-9c7d-913fbf2e84d1" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:50:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3ab69ad2-deff-4133-85c5-731c96ca44a5 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "cinder-quobyte-4d64c9bc-e60b-42d0-9c7d-913fbf2e84d1" acquired by "delete_volume" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:50:22 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e62cd8f-120f-45bd-89c0-b18d59de2a52]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:50:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3ab69ad2-deff-4133-85c5-731c96ca44a5 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4d64c9bc-e60b-42d0-9c7d-913fbf2e84d1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:22 devstack sudo[104704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4d64c9bc-e60b-42d0-9c7d-913fbf2e84d1 Sep 05 11:50:22 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:23 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3ab69ad2-deff-4133-85c5-731c96ca44a5 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4d64c9bc-e60b-42d0-9c7d-913fbf2e84d1" returned: 0 in 0.347s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3ab69ad2-deff-4133-85c5-731c96ca44a5 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4d64c9bc-e60b-42d0-9c7d-913fbf2e84d1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:23 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4d64c9bc-e60b-42d0-9c7d-913fbf2e84d1 Sep 05 11:50:23 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:23 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3ab69ad2-deff-4133-85c5-731c96ca44a5 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-4d64c9bc-e60b-42d0-9c7d-913fbf2e84d1" returned: 0 in 0.238s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3ab69ad2-deff-4133-85c5-731c96ca44a5 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "cinder-quobyte-4d64c9bc-e60b-42d0-9c7d-913fbf2e84d1" released by "delete_volume" :: held 0.622s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:50:23 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-3ab69ad2-deff-4133-85c5-731c96ca44a5 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Created reservations ['28b1ef4b-068f-4bfc-8af8-32e6747cd496', '7190c0c4-7d4e-4bbd-a50b-035e3bd773e7', '3cdb984b-3733-4baf-820d-f80a10e37f27', 'de1b0c2f-0011-451a-9afc-b11bf290646b'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:50:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3ab69ad2-deff-4133-85c5-731c96ca44a5 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:50:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3ab69ad2-deff-4133-85c5-731c96ca44a5 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:50:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3ab69ad2-deff-4133-85c5-731c96ca44a5 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:50:23 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3ab69ad2-deff-4133-85c5-731c96ca44a5 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:50:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3ab69ad2-deff-4133-85c5-731c96ca44a5 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3ab69ad2-deff-4133-85c5-731c96ca44a5 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:23 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:50:23 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:23 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3ab69ad2-deff-4133-85c5-731c96ca44a5 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.242s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:23 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-3ab69ad2-deff-4133-85c5-731c96ca44a5 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:50:23 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3ab69ad2-deff-4133-85c5-731c96ca44a5 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Deleted volume successfully. Sep 05 11:50:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3ab69ad2-deff-4133-85c5-731c96ca44a5 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "cinder-4d64c9bc-e60b-42d0-9c7d-913fbf2e84d1-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:50:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-90c75cdd-0985-4b40-b7ae-0363d224ce26 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Acquiring lock "cinder-c8a783d7-0b18-4748-9955-15c7bb6bfd2d-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:50:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-90c75cdd-0985-4b40-b7ae-0363d224ce26 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "cinder-c8a783d7-0b18-4748-9955-15c7bb6bfd2d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:50:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-90c75cdd-0985-4b40-b7ae-0363d224ce26 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Acquiring lock "cinder-quobyte-c8a783d7-0b18-4748-9955-15c7bb6bfd2d" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:50:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-90c75cdd-0985-4b40-b7ae-0363d224ce26 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "cinder-quobyte-c8a783d7-0b18-4748-9955-15c7bb6bfd2d" acquired by "delete_volume" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:50:23 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b82154-f8de-4359-8dab-6129a978716a]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:50:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-90c75cdd-0985-4b40-b7ae-0363d224ce26 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c8a783d7-0b18-4748-9955-15c7bb6bfd2d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:24 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c8a783d7-0b18-4748-9955-15c7bb6bfd2d Sep 05 11:50:24 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:24 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-90c75cdd-0985-4b40-b7ae-0363d224ce26 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c8a783d7-0b18-4748-9955-15c7bb6bfd2d" returned: 0 in 0.331s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-90c75cdd-0985-4b40-b7ae-0363d224ce26 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c8a783d7-0b18-4748-9955-15c7bb6bfd2d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:24 devstack sudo[104722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c8a783d7-0b18-4748-9955-15c7bb6bfd2d Sep 05 11:50:24 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:24 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-90c75cdd-0985-4b40-b7ae-0363d224ce26 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c8a783d7-0b18-4748-9955-15c7bb6bfd2d" returned: 0 in 0.237s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-90c75cdd-0985-4b40-b7ae-0363d224ce26 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "cinder-quobyte-c8a783d7-0b18-4748-9955-15c7bb6bfd2d" released by "delete_volume" :: held 0.609s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:50:24 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-90c75cdd-0985-4b40-b7ae-0363d224ce26 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Created reservations ['d7c9b38b-cc03-4659-89fa-e9ebf7c9f5cb', '2722c010-3b53-4607-b1cb-444097bcd8d8', '51d71e3d-5e39-499f-b678-39bec6b84f7b', '8fbce4f6-af87-4259-962c-4698294f6617'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:50:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-90c75cdd-0985-4b40-b7ae-0363d224ce26 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:50:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-90c75cdd-0985-4b40-b7ae-0363d224ce26 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:50:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-90c75cdd-0985-4b40-b7ae-0363d224ce26 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:50:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-90c75cdd-0985-4b40-b7ae-0363d224ce26 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:50:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-90c75cdd-0985-4b40-b7ae-0363d224ce26 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-90c75cdd-0985-4b40-b7ae-0363d224ce26 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:24 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:50:24 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:24 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-90c75cdd-0985-4b40-b7ae-0363d224ce26 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.246s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:24 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-90c75cdd-0985-4b40-b7ae-0363d224ce26 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:50:24 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-90c75cdd-0985-4b40-b7ae-0363d224ce26 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Deleted volume successfully. Sep 05 11:50:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-90c75cdd-0985-4b40-b7ae-0363d224ce26 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "cinder-c8a783d7-0b18-4748-9955-15c7bb6bfd2d-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:50:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fc66a2f9-7bdf-4fa0-8c99-8e6509385909 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Acquiring lock "cinder-283592fb-ea1b-4a5b-935d-f085a33b0224-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:50:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fc66a2f9-7bdf-4fa0-8c99-8e6509385909 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "cinder-283592fb-ea1b-4a5b-935d-f085a33b0224-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:50:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fc66a2f9-7bdf-4fa0-8c99-8e6509385909 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Acquiring lock "cinder-quobyte-283592fb-ea1b-4a5b-935d-f085a33b0224" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:50:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fc66a2f9-7bdf-4fa0-8c99-8e6509385909 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "cinder-quobyte-283592fb-ea1b-4a5b-935d-f085a33b0224" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:50:25 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e8b315-cc89-46ea-b7b8-42f9074eebfa]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:50:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fc66a2f9-7bdf-4fa0-8c99-8e6509385909 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-283592fb-ea1b-4a5b-935d-f085a33b0224 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:25 devstack sudo[104728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-283592fb-ea1b-4a5b-935d-f085a33b0224 Sep 05 11:50:25 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:25 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fc66a2f9-7bdf-4fa0-8c99-8e6509385909 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-283592fb-ea1b-4a5b-935d-f085a33b0224" returned: 0 in 0.351s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fc66a2f9-7bdf-4fa0-8c99-8e6509385909 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-283592fb-ea1b-4a5b-935d-f085a33b0224 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:25 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-283592fb-ea1b-4a5b-935d-f085a33b0224 Sep 05 11:50:25 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:25 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fc66a2f9-7bdf-4fa0-8c99-8e6509385909 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-283592fb-ea1b-4a5b-935d-f085a33b0224" returned: 0 in 0.239s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fc66a2f9-7bdf-4fa0-8c99-8e6509385909 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "cinder-quobyte-283592fb-ea1b-4a5b-935d-f085a33b0224" released by "delete_volume" :: held 0.625s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:50:25 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-fc66a2f9-7bdf-4fa0-8c99-8e6509385909 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Created reservations ['e1317588-3b8c-4007-a7fe-3c0a192bb0ca', 'dc104dd9-fa09-4c6a-a368-ffb92390de1c', '584d0370-0744-4f48-af56-d4d766083fc2', 'cd588c30-f6b6-4027-8b87-8de03d04428d'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:50:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fc66a2f9-7bdf-4fa0-8c99-8e6509385909 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:50:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fc66a2f9-7bdf-4fa0-8c99-8e6509385909 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:50:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fc66a2f9-7bdf-4fa0-8c99-8e6509385909 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:50:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fc66a2f9-7bdf-4fa0-8c99-8e6509385909 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:50:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fc66a2f9-7bdf-4fa0-8c99-8e6509385909 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fc66a2f9-7bdf-4fa0-8c99-8e6509385909 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:25 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:50:25 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:26 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fc66a2f9-7bdf-4fa0-8c99-8e6509385909 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.233s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:26 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-fc66a2f9-7bdf-4fa0-8c99-8e6509385909 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:50:26 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-fc66a2f9-7bdf-4fa0-8c99-8e6509385909 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Deleted volume successfully. Sep 05 11:50:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fc66a2f9-7bdf-4fa0-8c99-8e6509385909 tempest-CreateVolumesFromSourceVolumeTest-815457447 None] Lock "cinder-283592fb-ea1b-4a5b-935d-f085a33b0224-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:50:28 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:50:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] Flow 'volume_create_manager' (6a3150d6-6b40-4f75-9411-a557f5382b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:50:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c340976b-b47f-4b36-ad71-bc8e9ac20c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c340976b-b47f-4b36-ad71-bc8e9ac20c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2038774472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c640fb1-632a-4a42-8e39-53eb1cfbdca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3090ae3caf944720a6b6f29f9fd56f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:50:29Z,use_quota=True,user_id='1fdf34a9850e4f7fb9b3cdbcd9c6237e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f9d59eb-e1ec-4c07-98f0-21c02e8ccfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f9d59eb-e1ec-4c07-98f0-21c02e8ccfa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (384feb54-d33d-4b56-bd30-23fac0080df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (384feb54-d33d-4b56-bd30-23fac0080df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c640fb1-632a-4a42-8e39-53eb1cfbdca1', 'volume_name': 'volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4add2878-f5cb-4a5b-a90a-a7b912d0d8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4add2878-f5cb-4a5b-a90a-a7b912d0d8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65f80330-cebb-4f6d-9cc7-a2fe3c4d4cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:28 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] Volume 6c640fb1-632a-4a42-8e39-53eb1cfbdca1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1', 'volume_size': 1} Sep 05 11:50:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:50:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:50:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2038774472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c640fb1-632a-4a42-8e39-53eb1cfbdca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3090ae3caf944720a6b6f29f9fd56f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:50:29Z,use_quota=True,user_id='1fdf34a9850e4f7fb9b3cdbcd9c6237e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:50:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] Creating volume 6c640fb1-632a-4a42-8e39-53eb1cfbdca1 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:50:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:50:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:50:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:50:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:50:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:50:28 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:50:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:28 devstack sudo[104739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1 1073741824 Sep 05 11:50:28 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:29 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1 1073741824" returned: 0 in 0.400s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:29 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1 Sep 05 11:50:29 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:29 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1" returned: 0 in 0.243s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:50:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65f80330-cebb-4f6d-9cc7-a2fe3c4d4cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3885c4f3-b2c7-4141-89d6-a737c782fa03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:29 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] Volume volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1 (6c640fb1-632a-4a42-8e39-53eb1cfbdca1): created successfully Sep 05 11:50:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3885c4f3-b2c7-4141-89d6-a737c782fa03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] Flow 'volume_create_manager' (6a3150d6-6b40-4f75-9411-a557f5382b8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:50:29 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-71a69c6f-ae3c-4e58-9c9e-96d52abd718a tempest-VolumeDependencyTests-1218764028 None] Created volume successfully. Sep 05 11:50:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8c9ea8bc-1467-45a0-91e6-41abe2f2053f tempest-VolumeDependencyTests-1218764028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:50:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8c9ea8bc-1467-45a0-91e6-41abe2f2053f tempest-VolumeDependencyTests-1218764028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:50:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-8c9ea8bc-1467-45a0-91e6-41abe2f2053f tempest-VolumeDependencyTests-1218764028 None] Creating offline snapshot 255939db-a3b6-4c43-98f0-74fbaf84bb07 of volume 6c640fb1-632a-4a42-8e39-53eb1cfbdca1 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:50:29 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cc77c4-7eb0-4589-aa53-03a064b38cf0]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:50:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8c9ea8bc-1467-45a0-91e6-41abe2f2053f tempest-VolumeDependencyTests-1218764028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:29 devstack sudo[104747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1 Sep 05 11:50:29 devstack sudo[104747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:30 devstack sudo[104747]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8c9ea8bc-1467-45a0-91e6-41abe2f2053f tempest-VolumeDependencyTests-1218764028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1" returned: 0 in 0.345s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8c9ea8bc-1467-45a0-91e6-41abe2f2053f tempest-VolumeDependencyTests-1218764028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1.255939db-a3b6-4c43-98f0-74fbaf84bb07 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:30 devstack sudo[104752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1.255939db-a3b6-4c43-98f0-74fbaf84bb07 1G Sep 05 11:50:30 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:30 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8c9ea8bc-1467-45a0-91e6-41abe2f2053f tempest-VolumeDependencyTests-1218764028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1.255939db-a3b6-4c43-98f0-74fbaf84bb07 1G" returned: 0 in 0.360s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8c9ea8bc-1467-45a0-91e6-41abe2f2053f tempest-VolumeDependencyTests-1218764028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1.255939db-a3b6-4c43-98f0-74fbaf84bb07 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:30 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1.255939db-a3b6-4c43-98f0-74fbaf84bb07 Sep 05 11:50:30 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:30 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8c9ea8bc-1467-45a0-91e6-41abe2f2053f tempest-VolumeDependencyTests-1218764028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1.255939db-a3b6-4c43-98f0-74fbaf84bb07" returned: 0 in 0.284s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:30 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-8c9ea8bc-1467-45a0-91e6-41abe2f2053f tempest-VolumeDependencyTests-1218764028 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1.255939db-a3b6-4c43-98f0-74fbaf84bb07 is being set with open permissions: ugo+rw Sep 05 11:50:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8c9ea8bc-1467-45a0-91e6-41abe2f2053f tempest-VolumeDependencyTests-1218764028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1.255939db-a3b6-4c43-98f0-74fbaf84bb07 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:30 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1.255939db-a3b6-4c43-98f0-74fbaf84bb07 Sep 05 11:50:30 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:31 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8c9ea8bc-1467-45a0-91e6-41abe2f2053f tempest-VolumeDependencyTests-1218764028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1.255939db-a3b6-4c43-98f0-74fbaf84bb07" returned: 0 in 0.238s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8c9ea8bc-1467-45a0-91e6-41abe2f2053f tempest-VolumeDependencyTests-1218764028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:31 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1.info Sep 05 11:50:31 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:31 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8c9ea8bc-1467-45a0-91e6-41abe2f2053f tempest-VolumeDependencyTests-1218764028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1.info" returned: 0 in 0.250s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:31 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-8c9ea8bc-1467-45a0-91e6-41abe2f2053f tempest-VolumeDependencyTests-1218764028 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1.info is being set with open permissions: ugo+rw Sep 05 11:50:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8c9ea8bc-1467-45a0-91e6-41abe2f2053f tempest-VolumeDependencyTests-1218764028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:31 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1.info Sep 05 11:50:31 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:31 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8c9ea8bc-1467-45a0-91e6-41abe2f2053f tempest-VolumeDependencyTests-1218764028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1.info" returned: 0 in 0.238s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8c9ea8bc-1467-45a0-91e6-41abe2f2053f tempest-VolumeDependencyTests-1218764028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.798s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:31 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-8c9ea8bc-1467-45a0-91e6-41abe2f2053f tempest-VolumeDependencyTests-1218764028 None] Create snapshot completed successfully Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:32 devstack sudo[104772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:50:32 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Flow 'volume_create_manager' (045a1b02-50c6-4037-bd01-57d367eed2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f39d3f-c745-45bf-93f7-08bab06c41e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f39d3f-c745-45bf-93f7-08bab06c41e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-789666962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78e0f5e0-71cc-46f6-8a70-55629a7c06c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3090ae3caf944720a6b6f29f9fd56f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=255939db-a3b6-4c43-98f0-74fbaf84bb07,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:50:32Z,use_quota=True,user_id='1fdf34a9850e4f7fb9b3cdbcd9c6237e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e38ebd0e-70ca-426a-aae3-9db8bfbc76b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e38ebd0e-70ca-426a-aae3-9db8bfbc76b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75e9fd73-b2e0-432a-a229-df0a47968435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75e9fd73-b2e0-432a-a229-df0a47968435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '78e0f5e0-71cc-46f6-8a70-55629a7c06c3', 'volume_name': 'volume-78e0f5e0-71cc-46f6-8a70-55629a7c06c3', 'volume_size': 1, 'snapshot_id': '255939db-a3b6-4c43-98f0-74fbaf84bb07'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c8ed76a-1b25-4ff3-aefa-3290a6c15e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c8ed76a-1b25-4ff3-aefa-3290a6c15e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3933cecc-f9f5-44df-81af-fe2d32bc0c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:32 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Volume 78e0f5e0-71cc-46f6-8a70-55629a7c06c3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-78e0f5e0-71cc-46f6-8a70-55629a7c06c3', 'volume_size': 1, 'snapshot_id': '255939db-a3b6-4c43-98f0-74fbaf84bb07'} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Acquiring lock "cinder-quobyte-255939db-a3b6-4c43-98f0-74fbaf84bb07-78e0f5e0-71cc-46f6-8a70-55629a7c06c3" by "_create_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Lock "cinder-quobyte-255939db-a3b6-4c43-98f0-74fbaf84bb07-78e0f5e0-71cc-46f6-8a70-55629a7c06c3" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Creating volume 78e0f5e0-71cc-46f6-8a70-55629a7c06c3 from snapshot 255939db-a3b6-4c43-98f0-74fbaf84bb07 {{(pid=87517) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Acquiring lock "cinder-quobyte-78e0f5e0-71cc-46f6-8a70-55629a7c06c3" by "_copy_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Lock "cinder-quobyte-78e0f5e0-71cc-46f6-8a70-55629a7c06c3" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] snapshot: 255939db-a3b6-4c43-98f0-74fbaf84bb07, volume: 78e0f5e0-71cc-46f6-8a70-55629a7c06c3, {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 11:50:32 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.256s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread count: 28 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread info: [<_MainThread(MainThread, started 131707869511808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a15203-7fcd-4407-b7ae-41560fd90cc8]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1.255939db-a3b6-4c43-98f0-74fbaf84bb07 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:32 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1.255939db-a3b6-4c43-98f0-74fbaf84bb07 Sep 05 11:50:32 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:32 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1.255939db-a3b6-4c43-98f0-74fbaf84bb07" returned: 0 in 0.348s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3568a56-621d-4da4-a23f-cf68b615f13e]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:50:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:33 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1 Sep 05 11:50:33 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:33 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1" returned: 0 in 0.347s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1 {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 11:50:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Creating direct copy from snapshot {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 11:50:33 devstack cinder-volume[87517]: DEBUG cinder.utils [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Path /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-78e0f5e0-71cc-46f6-8a70-55629a7c06c3 not found in is_blk_device check {{(pid=87517) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 11:50:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-78e0f5e0-71cc-46f6-8a70-55629a7c06c3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:33 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-78e0f5e0-71cc-46f6-8a70-55629a7c06c3 Sep 05 11:50:33 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:37 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-78e0f5e0-71cc-46f6-8a70-55629a7c06c3" returned: 0 in 4.026s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:37 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Image conversion details: src /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1, size 1024.00 MB, duration 4.03 sec, destination /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-78e0f5e0-71cc-46f6-8a70-55629a7c06c3 {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 11:50:37 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Converted 1024.00 MB image at 254.27 MB/s Sep 05 11:50:37 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-78e0f5e0-71cc-46f6-8a70-55629a7c06c3 is being set with open permissions: ugo+rw Sep 05 11:50:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-78e0f5e0-71cc-46f6-8a70-55629a7c06c3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:37 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-78e0f5e0-71cc-46f6-8a70-55629a7c06c3 Sep 05 11:50:37 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:37 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-78e0f5e0-71cc-46f6-8a70-55629a7c06c3" returned: 0 in 0.256s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Lock "cinder-quobyte-78e0f5e0-71cc-46f6-8a70-55629a7c06c3" released by "_copy_volume_from_snapshot" :: held 5.065s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:50:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Lock "cinder-quobyte-255939db-a3b6-4c43-98f0-74fbaf84bb07-78e0f5e0-71cc-46f6-8a70-55629a7c06c3" released by "_create_volume_from_snapshot" :: held 5.132s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:50:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.148s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3933cecc-f9f5-44df-81af-fe2d32bc0c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78e0f5e0-71cc-46f6-8a70-55629a7c06c3', 'volume_size': 1, 'snapshot_id': '255939db-a3b6-4c43-98f0-74fbaf84bb07'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4a8554-b776-4d5e-a796-697e220f17d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:50:37 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Volume volume-78e0f5e0-71cc-46f6-8a70-55629a7c06c3 (78e0f5e0-71cc-46f6-8a70-55629a7c06c3): created successfully Sep 05 11:50:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4a8554-b776-4d5e-a796-697e220f17d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:50:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Flow 'volume_create_manager' (045a1b02-50c6-4037-bd01-57d367eed2d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:50:37 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-baf6312a-a8db-4a7a-aa97-28a07e031e60 tempest-VolumeDependencyTests-1218764028 None] Created volume successfully. Sep 05 11:50:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fd8e12b5-4f40-4dee-81a6-1d34250f7796 tempest-VolumeDependencyTests-1218764028 None] Acquiring lock "cinder-255939db-a3b6-4c43-98f0-74fbaf84bb07-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:50:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fd8e12b5-4f40-4dee-81a6-1d34250f7796 tempest-VolumeDependencyTests-1218764028 None] Lock "cinder-255939db-a3b6-4c43-98f0-74fbaf84bb07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:50:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fd8e12b5-4f40-4dee-81a6-1d34250f7796 tempest-VolumeDependencyTests-1218764028 None] Acquiring lock "cinder-quobyte-6c640fb1-632a-4a42-8e39-53eb1cfbdca1" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:50:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fd8e12b5-4f40-4dee-81a6-1d34250f7796 tempest-VolumeDependencyTests-1218764028 None] Lock "cinder-quobyte-6c640fb1-632a-4a42-8e39-53eb1cfbdca1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:50:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fd8e12b5-4f40-4dee-81a6-1d34250f7796 tempest-VolumeDependencyTests-1218764028 None] Acquiring lock "cinder-quobyte-255939db-a3b6-4c43-98f0-74fbaf84bb07" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:50:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fd8e12b5-4f40-4dee-81a6-1d34250f7796 tempest-VolumeDependencyTests-1218764028 None] Lock "cinder-quobyte-255939db-a3b6-4c43-98f0-74fbaf84bb07" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:50:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-fd8e12b5-4f40-4dee-81a6-1d34250f7796 tempest-VolumeDependencyTests-1218764028 None] Deleting offline snapshot 255939db-a3b6-4c43-98f0-74fbaf84bb07 of volume 6c640fb1-632a-4a42-8e39-53eb1cfbdca1 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:50:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-fd8e12b5-4f40-4dee-81a6-1d34250f7796 tempest-VolumeDependencyTests-1218764028 None] snapshot_file for this snap is: volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1.255939db-a3b6-4c43-98f0-74fbaf84bb07 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:50:37 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b6308f-15d4-4b0a-9ade-f7fd756f4da6]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:50:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fd8e12b5-4f40-4dee-81a6-1d34250f7796 tempest-VolumeDependencyTests-1218764028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1.255939db-a3b6-4c43-98f0-74fbaf84bb07 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:38 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1.255939db-a3b6-4c43-98f0-74fbaf84bb07 Sep 05 11:50:38 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:38 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fd8e12b5-4f40-4dee-81a6-1d34250f7796 tempest-VolumeDependencyTests-1218764028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1.255939db-a3b6-4c43-98f0-74fbaf84bb07" returned: 0 in 0.345s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-fd8e12b5-4f40-4dee-81a6-1d34250f7796 tempest-VolumeDependencyTests-1218764028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:50:38 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[750367ea-6b34-4b8e-80b6-f8ae80e78530]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:50:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fd8e12b5-4f40-4dee-81a6-1d34250f7796 tempest-VolumeDependencyTests-1218764028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:38 devstack sudo[104842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1 Sep 05 11:50:38 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:38 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fd8e12b5-4f40-4dee-81a6-1d34250f7796 tempest-VolumeDependencyTests-1218764028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1" returned: 0 in 0.526s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fd8e12b5-4f40-4dee-81a6-1d34250f7796 tempest-VolumeDependencyTests-1218764028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1.255939db-a3b6-4c43-98f0-74fbaf84bb07 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:38 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1.255939db-a3b6-4c43-98f0-74fbaf84bb07 Sep 05 11:50:38 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:39 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fd8e12b5-4f40-4dee-81a6-1d34250f7796 tempest-VolumeDependencyTests-1218764028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1.255939db-a3b6-4c43-98f0-74fbaf84bb07" returned: 0 in 0.318s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fd8e12b5-4f40-4dee-81a6-1d34250f7796 tempest-VolumeDependencyTests-1218764028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1.255939db-a3b6-4c43-98f0-74fbaf84bb07 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:39 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1.255939db-a3b6-4c43-98f0-74fbaf84bb07 Sep 05 11:50:39 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:39 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fd8e12b5-4f40-4dee-81a6-1d34250f7796 tempest-VolumeDependencyTests-1218764028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1.255939db-a3b6-4c43-98f0-74fbaf84bb07" returned: 0 in 0.247s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fd8e12b5-4f40-4dee-81a6-1d34250f7796 tempest-VolumeDependencyTests-1218764028 None] Lock "cinder-quobyte-255939db-a3b6-4c43-98f0-74fbaf84bb07" released by "_delete_snapshot" :: held 1.523s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:50:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fd8e12b5-4f40-4dee-81a6-1d34250f7796 tempest-VolumeDependencyTests-1218764028 None] Lock "cinder-quobyte-6c640fb1-632a-4a42-8e39-53eb1cfbdca1" released by "delete_snapshot" :: held 1.545s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:50:39 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-fd8e12b5-4f40-4dee-81a6-1d34250f7796 tempest-VolumeDependencyTests-1218764028 None] Created reservations ['9dad16d0-4ce1-4fa7-9ae4-94b59e232f24', 'a5efd9bb-4b0b-4f8e-848e-460c75633f62', '95f1b50d-b578-49e8-b983-da9de012b7e6', '1b03ac1f-ea34-4011-bf40-ce7f316f31e5'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:50:39 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-fd8e12b5-4f40-4dee-81a6-1d34250f7796 tempest-VolumeDependencyTests-1218764028 None] Delete snapshot completed successfully. Sep 05 11:50:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fd8e12b5-4f40-4dee-81a6-1d34250f7796 tempest-VolumeDependencyTests-1218764028 None] Lock "cinder-255939db-a3b6-4c43-98f0-74fbaf84bb07-delete_snapshot" released by "delete_snapshot" :: held 1.678s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:50:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e5996b3c-5cfa-4650-a2e7-7aa9f3bc2a6d tempest-VolumeDependencyTests-1218764028 None] Acquiring lock "cinder-6c640fb1-632a-4a42-8e39-53eb1cfbdca1-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:50:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e5996b3c-5cfa-4650-a2e7-7aa9f3bc2a6d tempest-VolumeDependencyTests-1218764028 None] Lock "cinder-6c640fb1-632a-4a42-8e39-53eb1cfbdca1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:50:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e5996b3c-5cfa-4650-a2e7-7aa9f3bc2a6d tempest-VolumeDependencyTests-1218764028 None] Acquiring lock "cinder-quobyte-6c640fb1-632a-4a42-8e39-53eb1cfbdca1" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:50:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e5996b3c-5cfa-4650-a2e7-7aa9f3bc2a6d tempest-VolumeDependencyTests-1218764028 None] Lock "cinder-quobyte-6c640fb1-632a-4a42-8e39-53eb1cfbdca1" acquired by "delete_volume" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:50:40 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[841387b5-347c-4193-a316-0649a31794a7]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:50:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e5996b3c-5cfa-4650-a2e7-7aa9f3bc2a6d tempest-VolumeDependencyTests-1218764028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:40 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1 Sep 05 11:50:40 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:40 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e5996b3c-5cfa-4650-a2e7-7aa9f3bc2a6d tempest-VolumeDependencyTests-1218764028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1" returned: 0 in 0.348s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e5996b3c-5cfa-4650-a2e7-7aa9f3bc2a6d tempest-VolumeDependencyTests-1218764028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:40 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1 Sep 05 11:50:40 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:40 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e5996b3c-5cfa-4650-a2e7-7aa9f3bc2a6d tempest-VolumeDependencyTests-1218764028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6c640fb1-632a-4a42-8e39-53eb1cfbdca1" returned: 0 in 0.234s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e5996b3c-5cfa-4650-a2e7-7aa9f3bc2a6d tempest-VolumeDependencyTests-1218764028 None] Lock "cinder-quobyte-6c640fb1-632a-4a42-8e39-53eb1cfbdca1" released by "delete_volume" :: held 0.635s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:50:40 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-e5996b3c-5cfa-4650-a2e7-7aa9f3bc2a6d tempest-VolumeDependencyTests-1218764028 None] Created reservations ['976a5983-e229-45af-a6c0-027f93a5d213', '17224fe3-0763-429f-b89c-236117baa268', 'a2fb6f40-1996-4c29-8f19-7c400adb7308', '31bd1980-0034-4d6b-ade0-8ca06f0a845e'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:50:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e5996b3c-5cfa-4650-a2e7-7aa9f3bc2a6d tempest-VolumeDependencyTests-1218764028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:50:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e5996b3c-5cfa-4650-a2e7-7aa9f3bc2a6d tempest-VolumeDependencyTests-1218764028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:50:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e5996b3c-5cfa-4650-a2e7-7aa9f3bc2a6d tempest-VolumeDependencyTests-1218764028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:50:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e5996b3c-5cfa-4650-a2e7-7aa9f3bc2a6d tempest-VolumeDependencyTests-1218764028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:50:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e5996b3c-5cfa-4650-a2e7-7aa9f3bc2a6d tempest-VolumeDependencyTests-1218764028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e5996b3c-5cfa-4650-a2e7-7aa9f3bc2a6d tempest-VolumeDependencyTests-1218764028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:40 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:50:40 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:41 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e5996b3c-5cfa-4650-a2e7-7aa9f3bc2a6d tempest-VolumeDependencyTests-1218764028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.238s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:41 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-e5996b3c-5cfa-4650-a2e7-7aa9f3bc2a6d tempest-VolumeDependencyTests-1218764028 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:50:41 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e5996b3c-5cfa-4650-a2e7-7aa9f3bc2a6d tempest-VolumeDependencyTests-1218764028 None] Deleted volume successfully. Sep 05 11:50:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e5996b3c-5cfa-4650-a2e7-7aa9f3bc2a6d tempest-VolumeDependencyTests-1218764028 None] Lock "cinder-6c640fb1-632a-4a42-8e39-53eb1cfbdca1-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:50:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9bd9dec1-5042-4883-bf14-a12b2f9b0a78 tempest-VolumeDependencyTests-1218764028 None] Acquiring lock "cinder-78e0f5e0-71cc-46f6-8a70-55629a7c06c3-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:50:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9bd9dec1-5042-4883-bf14-a12b2f9b0a78 tempest-VolumeDependencyTests-1218764028 None] Lock "cinder-78e0f5e0-71cc-46f6-8a70-55629a7c06c3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:50:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9bd9dec1-5042-4883-bf14-a12b2f9b0a78 tempest-VolumeDependencyTests-1218764028 None] Acquiring lock "cinder-quobyte-78e0f5e0-71cc-46f6-8a70-55629a7c06c3" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:50:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9bd9dec1-5042-4883-bf14-a12b2f9b0a78 tempest-VolumeDependencyTests-1218764028 None] Lock "cinder-quobyte-78e0f5e0-71cc-46f6-8a70-55629a7c06c3" acquired by "delete_volume" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:50:41 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb539131-8ead-4394-b355-c26c7fcc86d4]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:50:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9bd9dec1-5042-4883-bf14-a12b2f9b0a78 tempest-VolumeDependencyTests-1218764028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-78e0f5e0-71cc-46f6-8a70-55629a7c06c3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:41 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-78e0f5e0-71cc-46f6-8a70-55629a7c06c3 Sep 05 11:50:41 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:41 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9bd9dec1-5042-4883-bf14-a12b2f9b0a78 tempest-VolumeDependencyTests-1218764028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-78e0f5e0-71cc-46f6-8a70-55629a7c06c3" returned: 0 in 0.354s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9bd9dec1-5042-4883-bf14-a12b2f9b0a78 tempest-VolumeDependencyTests-1218764028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-78e0f5e0-71cc-46f6-8a70-55629a7c06c3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:41 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-78e0f5e0-71cc-46f6-8a70-55629a7c06c3 Sep 05 11:50:41 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:41 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9bd9dec1-5042-4883-bf14-a12b2f9b0a78 tempest-VolumeDependencyTests-1218764028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-78e0f5e0-71cc-46f6-8a70-55629a7c06c3" returned: 0 in 0.242s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9bd9dec1-5042-4883-bf14-a12b2f9b0a78 tempest-VolumeDependencyTests-1218764028 None] Lock "cinder-quobyte-78e0f5e0-71cc-46f6-8a70-55629a7c06c3" released by "delete_volume" :: held 0.632s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:50:41 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-9bd9dec1-5042-4883-bf14-a12b2f9b0a78 tempest-VolumeDependencyTests-1218764028 None] Created reservations ['8f534c36-16f3-4ac3-9040-139396b008ce', 'fa5100d4-3399-4329-b9e5-8cd5850c43c5', 'fb2855b7-e354-4993-8da1-6fc1fb59393a', '447c1b23-90dc-4cb6-be23-d8b96f58d551'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:50:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9bd9dec1-5042-4883-bf14-a12b2f9b0a78 tempest-VolumeDependencyTests-1218764028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:50:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9bd9dec1-5042-4883-bf14-a12b2f9b0a78 tempest-VolumeDependencyTests-1218764028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:50:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9bd9dec1-5042-4883-bf14-a12b2f9b0a78 tempest-VolumeDependencyTests-1218764028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:50:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9bd9dec1-5042-4883-bf14-a12b2f9b0a78 tempest-VolumeDependencyTests-1218764028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:50:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9bd9dec1-5042-4883-bf14-a12b2f9b0a78 tempest-VolumeDependencyTests-1218764028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:50:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9bd9dec1-5042-4883-bf14-a12b2f9b0a78 tempest-VolumeDependencyTests-1218764028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:50:41 devstack sudo[104874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:50:42 devstack sudo[104874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:50:42 devstack sudo[104874]: pam_unix(sudo:session): session closed for user root Sep 05 11:50:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9bd9dec1-5042-4883-bf14-a12b2f9b0a78 tempest-VolumeDependencyTests-1218764028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.241s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:50:42 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-9bd9dec1-5042-4883-bf14-a12b2f9b0a78 tempest-VolumeDependencyTests-1218764028 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:50:42 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-9bd9dec1-5042-4883-bf14-a12b2f9b0a78 tempest-VolumeDependencyTests-1218764028 None] Deleted volume successfully. Sep 05 11:50:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9bd9dec1-5042-4883-bf14-a12b2f9b0a78 tempest-VolumeDependencyTests-1218764028 None] Lock "cinder-78e0f5e0-71cc-46f6-8a70-55629a7c06c3-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:50:51 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=92,cinder:INSERT=37,cinder:UPDATE=133,cinder:DELETE=10 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:50:52 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=100,cinder:INSERT=36,cinder:UPDATE=129,cinder:DELETE=12 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:51:01 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:51:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Flow 'volume_create_manager' (18de3243-b65b-4424-aeb9-93ff9f74778d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e7c51b8-a99b-42e4-909f-ffaaeda58df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e7c51b8-a99b-42e4-909f-ffaaeda58df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1321910222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c98834f3-64d5-4e78-8b85-5de8a530451d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eabf3d514504d73a62015d446b4d055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:02Z,use_quota=True,user_id='9901c1993c7d4ad1b9adea94fb56f10a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (571f6794-76bb-47ce-b3a0-a215f1738fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (571f6794-76bb-47ce-b3a0-a215f1738fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e449449-7f14-4719-8ba2-1cd892be60a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e449449-7f14-4719-8ba2-1cd892be60a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c98834f3-64d5-4e78-8b85-5de8a530451d', 'volume_name': 'volume-c98834f3-64d5-4e78-8b85-5de8a530451d', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05afcdb7-655b-4aac-93d6-e09aeded337c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05afcdb7-655b-4aac-93d6-e09aeded337c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:01 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6705cbd-e006-43f7-a920-aa9e4ded2183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:01 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Volume c98834f3-64d5-4e78-8b85-5de8a530451d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c98834f3-64d5-4e78-8b85-5de8a530451d', 'volume_size': 1} Sep 05 11:51:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1321910222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c98834f3-64d5-4e78-8b85-5de8a530451d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eabf3d514504d73a62015d446b4d055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:02Z,use_quota=True,user_id='9901c1993c7d4ad1b9adea94fb56f10a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:51:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Creating volume c98834f3-64d5-4e78-8b85-5de8a530451d {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:51:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:51:01 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:51:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c98834f3-64d5-4e78-8b85-5de8a530451d 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:02 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c98834f3-64d5-4e78-8b85-5de8a530451d 1073741824 Sep 05 11:51:02 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:02 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:51:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] Flow 'volume_create_manager' (1bedd0e9-45c5-4820-831d-bf8de806e909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40340250-ae35-4d0b-a28e-e700b49c7ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40340250-ae35-4d0b-a28e-e700b49c7ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1268326026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22b0824b-e727-4a1c-8a5c-dfa5d267033d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80f486c1b9145009e18c4b05525483e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:02Z,use_quota=True,user_id='2cbe8e88b4fc4d1aba9ef4b2684b2788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0638a2-5bc1-4d41-812d-fc6f2eb69721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0638a2-5bc1-4d41-812d-fc6f2eb69721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f50b9c3-bac0-4503-be7a-4ec2103d29e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f50b9c3-bac0-4503-be7a-4ec2103d29e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22b0824b-e727-4a1c-8a5c-dfa5d267033d', 'volume_name': 'volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a28a046a-157a-420c-9a21-f10ab2478136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a28a046a-157a-420c-9a21-f10ab2478136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b277f657-3414-4325-9f1a-6b26520f728a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:02 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] Volume 22b0824b-e727-4a1c-8a5c-dfa5d267033d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d', 'volume_size': 1} Sep 05 11:51:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:02 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c98834f3-64d5-4e78-8b85-5de8a530451d 1073741824" returned: 0 in 0.592s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c98834f3-64d5-4e78-8b85-5de8a530451d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:02 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c98834f3-64d5-4e78-8b85-5de8a530451d Sep 05 11:51:02 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:02 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c98834f3-64d5-4e78-8b85-5de8a530451d" returned: 0 in 0.298s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:02 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:51:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.472s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:02 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1268326026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22b0824b-e727-4a1c-8a5c-dfa5d267033d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80f486c1b9145009e18c4b05525483e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:02Z,use_quota=True,user_id='2cbe8e88b4fc4d1aba9ef4b2684b2788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:51:02 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] Creating volume 22b0824b-e727-4a1c-8a5c-dfa5d267033d {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:51:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:02 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:02 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:02 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:51:02 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:51:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:02 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d 1073741824 Sep 05 11:51:02 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6705cbd-e006-43f7-a920-aa9e4ded2183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c98834f3-64d5-4e78-8b85-5de8a530451d', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:02 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (837e35f8-65da-474c-812a-0e766c494f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:03 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Volume volume-c98834f3-64d5-4e78-8b85-5de8a530451d (c98834f3-64d5-4e78-8b85-5de8a530451d): created successfully Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (837e35f8-65da-474c-812a-0e766c494f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Flow 'volume_create_manager' (18de3243-b65b-4424-aeb9-93ff9f74778d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:03 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7c653ea1-6b55-4a65-af43-79e2b0481ff2 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Created volume successfully. Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] Flow 'volume_create_manager' (df06653a-9eff-4c0a-a646-0af0a658c8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e15dae03-a133-48c3-bef8-aff0107a0a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e15dae03-a133-48c3-bef8-aff0107a0a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-834034362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3263eabd-87f6-43e9-a3e2-13e47b40dd9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21538d62ca2a428f992d6377b3ae13f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:03Z,use_quota=True,user_id='74a06c104a864c7e91e4950ed800de92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6987dde-1444-4816-bb4e-774fae559dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6987dde-1444-4816-bb4e-774fae559dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d57d92-8439-43cc-8163-30659a57f47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d57d92-8439-43cc-8163-30659a57f47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3263eabd-87f6-43e9-a3e2-13e47b40dd9d', 'volume_name': 'volume-3263eabd-87f6-43e9-a3e2-13e47b40dd9d', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52a1b722-4089-43c2-bcfb-30cd6e895945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52a1b722-4089-43c2-bcfb-30cd6e895945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (329a71ad-42a7-4384-8bbc-818cf5869542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:03 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] Volume 3263eabd-87f6-43e9-a3e2-13e47b40dd9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3263eabd-87f6-43e9-a3e2-13e47b40dd9d', 'volume_size': 1} Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:03 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d 1073741824" returned: 0 in 0.473s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:03 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d Sep 05 11:51:03 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:03 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d" returned: 0 in 0.261s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.492s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-834034362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3263eabd-87f6-43e9-a3e2-13e47b40dd9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21538d62ca2a428f992d6377b3ae13f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:03Z,use_quota=True,user_id='74a06c104a864c7e91e4950ed800de92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] Creating volume 3263eabd-87f6-43e9-a3e2-13e47b40dd9d {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:51:03 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3263eabd-87f6-43e9-a3e2-13e47b40dd9d 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b277f657-3414-4325-9f1a-6b26520f728a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:03 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3263eabd-87f6-43e9-a3e2-13e47b40dd9d 1073741824 Sep 05 11:51:03 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ac3273-cc56-43fd-a7fd-f775f6817ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:03 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] Volume volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d (22b0824b-e727-4a1c-8a5c-dfa5d267033d): created successfully Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ac3273-cc56-43fd-a7fd-f775f6817ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:03 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] Flow 'volume_create_manager' (1bedd0e9-45c5-4820-831d-bf8de806e909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:03 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7f285218-3e27-4ccf-84c1-6376338378b4 tempest-CreateVolumesFromSnapshotTest-542375037 None] Created volume successfully. Sep 05 11:51:04 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3263eabd-87f6-43e9-a3e2-13e47b40dd9d 1073741824" returned: 0 in 0.504s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3263eabd-87f6-43e9-a3e2-13e47b40dd9d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:04 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3263eabd-87f6-43e9-a3e2-13e47b40dd9d Sep 05 11:51:04 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:04 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:51:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Flow 'volume_create_manager' (dd0b82a4-7c8d-4e31-8cd9-e36f6a51575b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed7089b7-74a7-4cbd-b7ea-cbdea68ecaa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed7089b7-74a7-4cbd-b7ea-cbdea68ecaa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-966110824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ecbbe60-23be-46f3-a7f9-dd53ab929358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eabf3d514504d73a62015d446b4d055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:04Z,use_quota=True,user_id='9901c1993c7d4ad1b9adea94fb56f10a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf8fc928-568f-4c68-a372-a97bc61bd2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf8fc928-568f-4c68-a372-a97bc61bd2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:04 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6544b7cb-9e18-4759-ae84-1ac9882da26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6544b7cb-9e18-4759-ae84-1ac9882da26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ecbbe60-23be-46f3-a7f9-dd53ab929358', 'volume_name': 'volume-6ecbbe60-23be-46f3-a7f9-dd53ab929358', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02d20550-87c9-4a60-9d79-9f98e6fe68fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02d20550-87c9-4a60-9d79-9f98e6fe68fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d682246d-a61d-40ce-b309-508215a3271d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:04 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Volume 6ecbbe60-23be-46f3-a7f9-dd53ab929358: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ecbbe60-23be-46f3-a7f9-dd53ab929358', 'volume_size': 1} Sep 05 11:51:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3263eabd-87f6-43e9-a3e2-13e47b40dd9d" returned: 0 in 0.365s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:51:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-966110824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ecbbe60-23be-46f3-a7f9-dd53ab929358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eabf3d514504d73a62015d446b4d055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:04Z,use_quota=True,user_id='9901c1993c7d4ad1b9adea94fb56f10a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:51:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Creating volume 6ecbbe60-23be-46f3-a7f9-dd53ab929358 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:51:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:51:04 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:51:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6ecbbe60-23be-46f3-a7f9-dd53ab929358 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:04 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6ecbbe60-23be-46f3-a7f9-dd53ab929358 1073741824 Sep 05 11:51:04 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (329a71ad-42a7-4384-8bbc-818cf5869542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3263eabd-87f6-43e9-a3e2-13e47b40dd9d', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (699e3229-f653-45fe-aef9-3e147961fc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:04 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] Volume volume-3263eabd-87f6-43e9-a3e2-13e47b40dd9d (3263eabd-87f6-43e9-a3e2-13e47b40dd9d): created successfully Sep 05 11:51:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (699e3229-f653-45fe-aef9-3e147961fc82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] Flow 'volume_create_manager' (df06653a-9eff-4c0a-a646-0af0a658c8e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:04 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-faf715ff-ffc0-4bb1-925f-e3d8c0903767 tempest-ProjectReaderTests-232353913 None] Created volume successfully. Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-255a8528-b7fb-4608-b751-517f37f3eaf5 tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Flow 'volume_create_manager' (80399678-8472-4122-965d-3a8db4503da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a753ddd8-1fec-47c8-a73f-1d384ebcb9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a753ddd8-1fec-47c8-a73f-1d384ebcb9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1043500267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67d6d8c3-927b-4438-a947-9e69c2a1cab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eabf3d514504d73a62015d446b4d055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:05Z,use_quota=True,user_id='9901c1993c7d4ad1b9adea94fb56f10a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3836071-268c-4c11-a560-4d36614f9cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:05 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3836071-268c-4c11-a560-4d36614f9cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fb12900-328f-4125-8581-73d0156fe500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fb12900-328f-4125-8581-73d0156fe500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67d6d8c3-927b-4438-a947-9e69c2a1cab6', 'volume_name': 'volume-67d6d8c3-927b-4438-a947-9e69c2a1cab6', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ad006f-1622-4986-94b9-b10d2986adb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ad006f-1622-4986-94b9-b10d2986adb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (310558b0-d0d8-4aea-b4ae-9397cbc69e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:05 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Volume 67d6d8c3-927b-4438-a947-9e69c2a1cab6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67d6d8c3-927b-4438-a947-9e69c2a1cab6', 'volume_size': 1} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6ecbbe60-23be-46f3-a7f9-dd53ab929358 1073741824" returned: 0 in 0.651s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6ecbbe60-23be-46f3-a7f9-dd53ab929358 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:05 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6ecbbe60-23be-46f3-a7f9-dd53ab929358 Sep 05 11:51:05 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7f2cab16-e3b9-4f2a-9d44-7758501b99ca tempest-ProjectReaderTests-232353913 None] Acquiring lock "cinder-3263eabd-87f6-43e9-a3e2-13e47b40dd9d-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7f2cab16-e3b9-4f2a-9d44-7758501b99ca tempest-ProjectReaderTests-232353913 None] Lock "cinder-3263eabd-87f6-43e9-a3e2-13e47b40dd9d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7f2cab16-e3b9-4f2a-9d44-7758501b99ca tempest-ProjectReaderTests-232353913 None] Acquiring lock "cinder-quobyte-3263eabd-87f6-43e9-a3e2-13e47b40dd9d" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Flow 'volume_create_manager' (76a154e7-c65e-4a54-a26d-39475e6dbea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (669e80b5-8a41-4ffb-af40-9e0af7d704b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7f2cab16-e3b9-4f2a-9d44-7758501b99ca tempest-ProjectReaderTests-232353913 None] Lock "cinder-quobyte-3263eabd-87f6-43e9-a3e2-13e47b40dd9d" acquired by "delete_volume" :: waited 0.057s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (669e80b5-8a41-4ffb-af40-9e0af7d704b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1429498741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d85bb5-d58a-4bcf-8398-7024d0c7b725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eabf3d514504d73a62015d446b4d055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:06Z,use_quota=True,user_id='9901c1993c7d4ad1b9adea94fb56f10a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1d48b5c-720d-4261-8bf6-b6ae525b2694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1d48b5c-720d-4261-8bf6-b6ae525b2694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b66f275f-7c11-449a-95aa-eb1e847ac7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b66f275f-7c11-449a-95aa-eb1e847ac7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63d85bb5-d58a-4bcf-8398-7024d0c7b725', 'volume_name': 'volume-63d85bb5-d58a-4bcf-8398-7024d0c7b725', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2c887a-9723-45a0-ab3b-ba2f46214165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:05 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2c887a-9723-45a0-ab3b-ba2f46214165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (920734ca-3a6b-4864-9077-7e2e7b24dc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:05 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Volume 63d85bb5-d58a-4bcf-8398-7024d0c7b725: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63d85bb5-d58a-4bcf-8398-7024d0c7b725', 'volume_size': 1} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[442e771e-81d8-44d9-824a-0fe2fac7b92a]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7f2cab16-e3b9-4f2a-9d44-7758501b99ca tempest-ProjectReaderTests-232353913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3263eabd-87f6-43e9-a3e2-13e47b40dd9d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6ecbbe60-23be-46f3-a7f9-dd53ab929358" returned: 0 in 0.439s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-255a8528-b7fb-4608-b751-517f37f3eaf5 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.663s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d682246d-a61d-40ce-b309-508215a3271d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ecbbe60-23be-46f3-a7f9-dd53ab929358', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d003530-0166-4bf6-9225-de161b2e0ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-255a8528-b7fb-4608-b751-517f37f3eaf5 tempest-CreateVolumesFromSnapshotTest-542375037 None] Creating offline snapshot a07d7f4f-1994-44af-b2cb-9e5f6bea234e of volume 22b0824b-e727-4a1c-8a5c-dfa5d267033d {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:51:05 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Volume volume-6ecbbe60-23be-46f3-a7f9-dd53ab929358 (6ecbbe60-23be-46f3-a7f9-dd53ab929358): created successfully Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d003530-0166-4bf6-9225-de161b2e0ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Flow 'volume_create_manager' (dd0b82a4-7c8d-4e31-8cd9-e36f6a51575b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6734b5-f544-47af-9412-2f31acd3690c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-255a8528-b7fb-4608-b751-517f37f3eaf5 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:05 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d077a450-07d5-4b58-8464-76ba79fe8d2d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Created volume successfully. Sep 05 11:51:05 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3263eabd-87f6-43e9-a3e2-13e47b40dd9d Sep 05 11:51:05 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:06 devstack sudo[104961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d Sep 05 11:51:06 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:51:06 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Flow 'volume_create_manager' (1920d4cf-08de-41a7-9716-5b1460bb8ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba8ac4c3-013f-4d22-9917-da29a4618eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7f2cab16-e3b9-4f2a-9d44-7758501b99ca tempest-ProjectReaderTests-232353913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3263eabd-87f6-43e9-a3e2-13e47b40dd9d" returned: 0 in 0.529s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7f2cab16-e3b9-4f2a-9d44-7758501b99ca tempest-ProjectReaderTests-232353913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3263eabd-87f6-43e9-a3e2-13e47b40dd9d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba8ac4c3-013f-4d22-9917-da29a4618eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-359296345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a14d20ab-adaf-4867-b252-e16e382eef5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eabf3d514504d73a62015d446b4d055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:06Z,use_quota=True,user_id='9901c1993c7d4ad1b9adea94fb56f10a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29557f03-c9af-4e12-a8cc-1bd1d2f838ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:06 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3263eabd-87f6-43e9-a3e2-13e47b40dd9d Sep 05 11:51:06 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29557f03-c9af-4e12-a8cc-1bd1d2f838ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86f22496-9e6a-4b0a-a9f9-433793283706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86f22496-9e6a-4b0a-a9f9-433793283706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a14d20ab-adaf-4867-b252-e16e382eef5a', 'volume_name': 'volume-a14d20ab-adaf-4867-b252-e16e382eef5a', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee9f656-888c-4adb-9886-3c0bdb43a405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee9f656-888c-4adb-9886-3c0bdb43a405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42eec184-521d-4e27-84b8-a1344b91aab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:06 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Volume a14d20ab-adaf-4867-b252-e16e382eef5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a14d20ab-adaf-4867-b252-e16e382eef5a', 'volume_size': 1} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:06 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-255a8528-b7fb-4608-b751-517f37f3eaf5 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d" returned: 0 in 0.512s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-255a8528-b7fb-4608-b751-517f37f3eaf5 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d.a07d7f4f-1994-44af-b2cb-9e5f6bea234e 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:06 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d.a07d7f4f-1994-44af-b2cb-9e5f6bea234e 1G Sep 05 11:51:06 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:06 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7f2cab16-e3b9-4f2a-9d44-7758501b99ca tempest-ProjectReaderTests-232353913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3263eabd-87f6-43e9-a3e2-13e47b40dd9d" returned: 0 in 0.371s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7f2cab16-e3b9-4f2a-9d44-7758501b99ca tempest-ProjectReaderTests-232353913 None] Lock "cinder-quobyte-3263eabd-87f6-43e9-a3e2-13e47b40dd9d" released by "delete_volume" :: held 0.996s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Flow 'volume_create_manager' (4d67a910-99f6-448f-a243-c1e60b2a7b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8d8e0cc-0dfb-4fef-b9ef-39b74099f114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8d8e0cc-0dfb-4fef-b9ef-39b74099f114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4f3b3b0-988c-46b4-a0b8-c7f1964f7050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='238875811061458e8f9a403dc62b6734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:07Z,use_quota=True,user_id='b48d510b8c7a42d3ba410b025c5ee5d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(310eba9b-b82c-4f71-a242-6bd47ead1b9f),volume_type_id=310eba9b-b82c-4f71-a242-6bd47ead1b9f)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97745c09-c303-4f9a-a583-40f390a16393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97745c09-c303-4f9a-a583-40f390a16393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1175bdd-f0f2-4bbb-8148-29427e94b42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG cinder.image.glance [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Creating Keystone auth plugin from conf {{(pid=87517) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-7f2cab16-e3b9-4f2a-9d44-7758501b99ca tempest-ProjectReaderTests-232353913 None] Created reservations ['d3ad6e3f-75fc-4470-96b7-4b35cd071388', '9465b12b-529c-431e-9331-fb1c3ed100dc', 'cf5dd433-a035-4f23-ae8a-e777aaeac5f4', '0c138420-8710-4a2d-aaf6-98e5b66816aa'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Flow 'volume_create_manager' (b020dcbc-1954-4d33-a1a0-9f927cb195b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5904b990-c3a6-4c4b-8122-e17b2d937976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5904b990-c3a6-4c4b-8122-e17b2d937976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2132511109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d22de6-28c4-4b1d-b15d-bcb49d91a16b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eabf3d514504d73a62015d446b4d055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:07Z,use_quota=True,user_id='9901c1993c7d4ad1b9adea94fb56f10a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:06 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e1e1e9-f793-4bbd-99e6-2bca5c8dbdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e1e1e9-f793-4bbd-99e6-2bca5c8dbdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35aec6d5-b472-46c6-9600-1cb22984ba6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35aec6d5-b472-46c6-9600-1cb22984ba6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1d22de6-28c4-4b1d-b15d-bcb49d91a16b', 'volume_name': 'volume-e1d22de6-28c4-4b1d-b15d-bcb49d91a16b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da167422-24d0-4837-bdca-eb5bb62119e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da167422-24d0-4837-bdca-eb5bb62119e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d38c38-d30e-45d9-9e18-b3eef5838ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:06 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Volume e1d22de6-28c4-4b1d-b15d-bcb49d91a16b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1d22de6-28c4-4b1d-b15d-bcb49d91a16b', 'volume_size': 1} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-255a8528-b7fb-4608-b751-517f37f3eaf5 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d.a07d7f4f-1994-44af-b2cb-9e5f6bea234e 1G" returned: 0 in 0.568s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-255a8528-b7fb-4608-b751-517f37f3eaf5 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d.a07d7f4f-1994-44af-b2cb-9e5f6bea234e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:06 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d.a07d7f4f-1994-44af-b2cb-9e5f6bea234e Sep 05 11:51:06 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7f2cab16-e3b9-4f2a-9d44-7758501b99ca tempest-ProjectReaderTests-232353913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7f2cab16-e3b9-4f2a-9d44-7758501b99ca tempest-ProjectReaderTests-232353913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7f2cab16-e3b9-4f2a-9d44-7758501b99ca tempest-ProjectReaderTests-232353913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7f2cab16-e3b9-4f2a-9d44-7758501b99ca tempest-ProjectReaderTests-232353913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7f2cab16-e3b9-4f2a-9d44-7758501b99ca tempest-ProjectReaderTests-232353913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7f2cab16-e3b9-4f2a-9d44-7758501b99ca tempest-ProjectReaderTests-232353913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:07 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:51:07 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1175bdd-f0f2-4bbb-8148-29427e94b42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e4f3b3b0-988c-46b4-a0b8-c7f1964f7050', 'volume_name': 'volume-e4f3b3b0-988c-46b4-a0b8-c7f1964f7050', 'volume_size': 1, 'image_id': '66ffaea9-8139-4958-991e-e0fbad45e7a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/66ffaea9-8139-4958-991e-e0fbad45e7a6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9923924f79c778248cb7be7eb5022340', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '238875811061458e8f9a403dc62b6734', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '22b7e3f48cf5f10010ea469cd820e94cc4e2b6531f1ea1dabe015679c02447d0fc556ea38c4605f1206181837862a183febfe1f2d3a20e5eb2bb6eae845c25df', 'id': '66ffaea9-8139-4958-991e-e0fbad45e7a6', 'created_at': datetime.datetime(2026, 9, 5, 9, 51, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 9, 51, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/66ffaea9-8139-4958-991e-e0fbad45e7a6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a70d8c3f-fe40-4c5c-a319-a98b757ed1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a70d8c3f-fe40-4c5c-a319-a98b757ed1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:07 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21af5da6-d8cf-4e36-b2f5-b85ec00ae42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:07 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Volume e4f3b3b0-988c-46b4-a0b8-c7f1964f7050: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e4f3b3b0-988c-46b4-a0b8-c7f1964f7050', 'volume_size': 1, 'image_id': '66ffaea9-8139-4958-991e-e0fbad45e7a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/66ffaea9-8139-4958-991e-e0fbad45e7a6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9923924f79c778248cb7be7eb5022340', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '238875811061458e8f9a403dc62b6734', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '22b7e3f48cf5f10010ea469cd820e94cc4e2b6531f1ea1dabe015679c02447d0fc556ea38c4605f1206181837862a183febfe1f2d3a20e5eb2bb6eae845c25df', 'id': '66ffaea9-8139-4958-991e-e0fbad45e7a6', 'created_at': datetime.datetime(2026, 9, 5, 9, 51, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 9, 51, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/66ffaea9-8139-4958-991e-e0fbad45e7a6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 05 11:51:07 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Trying to clone e4f3b3b0-988c-46b4-a0b8-c7f1964f7050 from image 66ffaea9-8139-4958-991e-e0fbad45e7a6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/66ffaea9-8139-4958-991e-e0fbad45e7a6', 'metadata': {}}]). {{(pid=87517) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 11:51:07 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_66ffaea9-8139-4958-991e-e0fbad45e7a6__5cy1up1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 11:51:07 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Image download 0.00 MB at 0.00 MB/s Sep 05 11:51:07 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e7a7a9-d175-42b8-af9d-7cfb51196d88]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66ffaea9-8139-4958-991e-e0fbad45e7a6__5cy1up1devstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:07 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:07 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7f2cab16-e3b9-4f2a-9d44-7758501b99ca tempest-ProjectReaderTests-232353913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.280s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-255a8528-b7fb-4608-b751-517f37f3eaf5 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d.a07d7f4f-1994-44af-b2cb-9e5f6bea234e" returned: 0 in 0.345s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:07 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-7f2cab16-e3b9-4f2a-9d44-7758501b99ca tempest-ProjectReaderTests-232353913 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:51:07 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-255a8528-b7fb-4608-b751-517f37f3eaf5 tempest-CreateVolumesFromSnapshotTest-542375037 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d.a07d7f4f-1994-44af-b2cb-9e5f6bea234e is being set with open permissions: ugo+rw Sep 05 11:51:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-255a8528-b7fb-4608-b751-517f37f3eaf5 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d.a07d7f4f-1994-44af-b2cb-9e5f6bea234e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:07 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7f2cab16-e3b9-4f2a-9d44-7758501b99ca tempest-ProjectReaderTests-232353913 None] Deleted volume successfully. Sep 05 11:51:07 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d.a07d7f4f-1994-44af-b2cb-9e5f6bea234e Sep 05 11:51:07 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-7f2cab16-e3b9-4f2a-9d44-7758501b99ca tempest-ProjectReaderTests-232353913 None] Lock "cinder-3263eabd-87f6-43e9-a3e2-13e47b40dd9d-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:07 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66ffaea9-8139-4958-991e-e0fbad45e7a6__5cy1up1devstack@QuobyteHD Sep 05 11:51:07 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:07 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-255a8528-b7fb-4608-b751-517f37f3eaf5 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d.a07d7f4f-1994-44af-b2cb-9e5f6bea234e" returned: 0 in 0.268s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-255a8528-b7fb-4608-b751-517f37f3eaf5 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:07 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66ffaea9-8139-4958-991e-e0fbad45e7a6__5cy1up1devstack@QuobyteHD" returned: 0 in 0.364s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66ffaea9-8139-4958-991e-e0fbad45e7a6__5cy1up1devstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:07 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d.info Sep 05 11:51:07 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:07 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66ffaea9-8139-4958-991e-e0fbad45e7a6__5cy1up1devstack@QuobyteHD Sep 05 11:51:07 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:07 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-255a8528-b7fb-4608-b751-517f37f3eaf5 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d.info" returned: 0 in 0.275s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:07 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-255a8528-b7fb-4608-b751-517f37f3eaf5 tempest-CreateVolumesFromSnapshotTest-542375037 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d.info is being set with open permissions: ugo+rw Sep 05 11:51:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-255a8528-b7fb-4608-b751-517f37f3eaf5 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:07 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d.info Sep 05 11:51:07 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:07 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66ffaea9-8139-4958-991e-e0fbad45e7a6__5cy1up1devstack@QuobyteHD" returned: 1 in 0.361s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66ffaea9-8139-4958-991e-e0fbad45e7a6__5cy1up1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 11:51:07 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Temporary image 66ffaea9-8139-4958-991e-e0fbad45e7a6 is fetched for user b48d510b8c7a42d3ba410b025c5ee5d2. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b8f586-6798-4373-a59a-cc393e8e8391]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66ffaea9-8139-4958-991e-e0fbad45e7a6__5cy1up1devstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:08 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-255a8528-b7fb-4608-b751-517f37f3eaf5 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d.info" returned: 0 in 0.290s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-255a8528-b7fb-4608-b751-517f37f3eaf5 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.408s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.903s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1043500267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67d6d8c3-927b-4438-a947-9e69c2a1cab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eabf3d514504d73a62015d446b4d055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:05Z,use_quota=True,user_id='9901c1993c7d4ad1b9adea94fb56f10a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Creating volume 67d6d8c3-927b-4438-a947-9e69c2a1cab6 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:51:08 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:51:08 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66ffaea9-8139-4958-991e-e0fbad45e7a6__5cy1up1devstack@QuobyteHD Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67d6d8c3-927b-4438-a947-9e69c2a1cab6 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:08 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:08 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67d6d8c3-927b-4438-a947-9e69c2a1cab6 1073741824 Sep 05 11:51:08 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:08 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-255a8528-b7fb-4608-b751-517f37f3eaf5 tempest-CreateVolumesFromSnapshotTest-542375037 None] Create snapshot completed successfully Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] Flow 'volume_create_manager' (868b079a-264e-4bcb-8140-1bdd2d8dd8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999bf9c8-e133-41da-b2ae-ed5bd7e1b597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999bf9c8-e133-41da-b2ae-ed5bd7e1b597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-101052289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ad47365-9908-4f3c-8a84-d64d6020132b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21538d62ca2a428f992d6377b3ae13f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:08Z,use_quota=True,user_id='74a06c104a864c7e91e4950ed800de92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4957f1d6-5f56-4fc9-8cf2-12d5d8f344b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4957f1d6-5f56-4fc9-8cf2-12d5d8f344b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5367976d-344e-4037-a732-e31b23570203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5367976d-344e-4037-a732-e31b23570203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ad47365-9908-4f3c-8a84-d64d6020132b', 'volume_name': 'volume-2ad47365-9908-4f3c-8a84-d64d6020132b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c61842-c391-4024-b268-7fc1e68971f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c61842-c391-4024-b268-7fc1e68971f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01530e0c-5511-4307-8ebf-7881b7e9856f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:08 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] Volume 2ad47365-9908-4f3c-8a84-d64d6020132b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ad47365-9908-4f3c-8a84-d64d6020132b', 'volume_size': 1} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:08 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66ffaea9-8139-4958-991e-e0fbad45e7a6__5cy1up1devstack@QuobyteHD" returned: 0 in 0.361s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66ffaea9-8139-4958-991e-e0fbad45e7a6__5cy1up1devstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:08 devstack sudo[105018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66ffaea9-8139-4958-991e-e0fbad45e7a6__5cy1up1devstack@QuobyteHD Sep 05 11:51:08 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:08 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67d6d8c3-927b-4438-a947-9e69c2a1cab6 1073741824" returned: 0 in 0.451s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67d6d8c3-927b-4438-a947-9e69c2a1cab6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:08 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67d6d8c3-927b-4438-a947-9e69c2a1cab6 Sep 05 11:51:08 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:08 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66ffaea9-8139-4958-991e-e0fbad45e7a6__5cy1up1devstack@QuobyteHD" returned: 1 in 0.361s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66ffaea9-8139-4958-991e-e0fbad45e7a6__5cy1up1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:08 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67d6d8c3-927b-4438-a947-9e69c2a1cab6" returned: 0 in 0.251s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.209s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1429498741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d85bb5-d58a-4bcf-8398-7024d0c7b725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eabf3d514504d73a62015d446b4d055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:06Z,use_quota=True,user_id='9901c1993c7d4ad1b9adea94fb56f10a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Creating volume 63d85bb5-d58a-4bcf-8398-7024d0c7b725 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:51:08 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:51:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-63d85bb5-d58a-4bcf-8398-7024d0c7b725 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (310558b0-d0d8-4aea-b4ae-9397cbc69e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67d6d8c3-927b-4438-a947-9e69c2a1cab6', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:09 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-63d85bb5-d58a-4bcf-8398-7024d0c7b725 1073741824 Sep 05 11:51:09 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba8bb3b-bbda-4537-a502-fa5ee3d23b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:09 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Volume volume-67d6d8c3-927b-4438-a947-9e69c2a1cab6 (67d6d8c3-927b-4438-a947-9e69c2a1cab6): created successfully Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba8bb3b-bbda-4537-a502-fa5ee3d23b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Flow 'volume_create_manager' (80399678-8472-4122-965d-3a8db4503da4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:09 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-0074800a-09cf-4d55-8e1c-d6c37bf91ddf tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Created volume successfully. Sep 05 11:51:09 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-63d85bb5-d58a-4bcf-8398-7024d0c7b725 1073741824" returned: 0 in 0.461s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-63d85bb5-d58a-4bcf-8398-7024d0c7b725 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:09 devstack sudo[105035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-63d85bb5-d58a-4bcf-8398-7024d0c7b725 Sep 05 11:51:09 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] Flow 'volume_create_manager' (9b06d16f-4314-43cc-a3f9-c61e722bf329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f0bab38-858c-4459-9552-53da97a65eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f0bab38-858c-4459-9552-53da97a65eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1128227738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20af6ddd-2df3-477f-8fec-52827627778a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80f486c1b9145009e18c4b05525483e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:10Z,use_quota=True,user_id='2cbe8e88b4fc4d1aba9ef4b2684b2788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8145302-43b8-41a6-9389-e1ab95834ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8145302-43b8-41a6-9389-e1ab95834ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de9b5906-f426-4ed4-978c-9c67c1c3ced5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de9b5906-f426-4ed4-978c-9c67c1c3ced5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20af6ddd-2df3-477f-8fec-52827627778a', 'volume_name': 'volume-20af6ddd-2df3-477f-8fec-52827627778a', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca770e6-ca30-4548-b6e8-18f96b3cb3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca770e6-ca30-4548-b6e8-18f96b3cb3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2f5e4df-5020-451d-a328-d4847e06342f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:09 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] Volume 20af6ddd-2df3-477f-8fec-52827627778a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20af6ddd-2df3-477f-8fec-52827627778a', 'volume_size': 1} Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:09 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-63d85bb5-d58a-4bcf-8398-7024d0c7b725" returned: 0 in 0.284s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.387s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-359296345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a14d20ab-adaf-4867-b252-e16e382eef5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eabf3d514504d73a62015d446b4d055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:06Z,use_quota=True,user_id='9901c1993c7d4ad1b9adea94fb56f10a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Creating volume a14d20ab-adaf-4867-b252-e16e382eef5a {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:51:09 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-a14d20ab-adaf-4867-b252-e16e382eef5a 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (920734ca-3a6b-4864-9077-7e2e7b24dc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63d85bb5-d58a-4bcf-8398-7024d0c7b725', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e735db1-a1a5-43a1-a4d6-78cfc8145cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:09 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-a14d20ab-adaf-4867-b252-e16e382eef5a 1073741824 Sep 05 11:51:09 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:09 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Volume volume-63d85bb5-d58a-4bcf-8398-7024d0c7b725 (63d85bb5-d58a-4bcf-8398-7024d0c7b725): created successfully Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e735db1-a1a5-43a1-a4d6-78cfc8145cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:09 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Flow 'volume_create_manager' (76a154e7-c65e-4a54-a26d-39475e6dbea1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:09 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-066146c4-c039-4846-9d4b-59403ed53db5 tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Created volume successfully. Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] Flow 'volume_create_manager' (ae8ec327-cd07-44c6-a0ca-6afd538bd0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cd7c8dd-c940-4bcf-bbef-2dc9498379a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cd7c8dd-c940-4bcf-bbef-2dc9498379a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1487017150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb70f019-4371-422b-b637-e252dc78737e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80f486c1b9145009e18c4b05525483e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:10Z,use_quota=True,user_id='2cbe8e88b4fc4d1aba9ef4b2684b2788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (561e57da-5a5c-45f3-a5e5-a2fba6a0058a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (561e57da-5a5c-45f3-a5e5-a2fba6a0058a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a84ff6d9-69f3-4c54-8184-bc984cdff33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a84ff6d9-69f3-4c54-8184-bc984cdff33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb70f019-4371-422b-b637-e252dc78737e', 'volume_name': 'volume-eb70f019-4371-422b-b637-e252dc78737e', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a6fc859-2599-45ac-80b9-4f36e2ffdc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a6fc859-2599-45ac-80b9-4f36e2ffdc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c6a12a5-32a4-40be-b067-471f7afd0b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:10 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] Volume eb70f019-4371-422b-b637-e252dc78737e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb70f019-4371-422b-b637-e252dc78737e', 'volume_size': 1} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:10 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-a14d20ab-adaf-4867-b252-e16e382eef5a 1073741824" returned: 0 in 0.579s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-a14d20ab-adaf-4867-b252-e16e382eef5a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:51:10 devstack sudo[105043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-a14d20ab-adaf-4867-b252-e16e382eef5a Sep 05 11:51:10 devstack sudo[105043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] Flow 'volume_create_manager' (ec7c3d5c-315b-404f-aec7-fa7c1288fd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88843934-ff9c-43e1-894e-878640f729de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88843934-ff9c-43e1-894e-878640f729de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1736237287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7116fd84-464e-46d4-828d-654e18546886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80f486c1b9145009e18c4b05525483e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:10Z,use_quota=True,user_id='2cbe8e88b4fc4d1aba9ef4b2684b2788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7931369-9a6f-48e4-aa4f-fbd13b6fe8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7931369-9a6f-48e4-aa4f-fbd13b6fe8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73fb9e0-b1d8-4b0e-b44e-d24a7c94dfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73fb9e0-b1d8-4b0e-b44e-d24a7c94dfaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7116fd84-464e-46d4-828d-654e18546886', 'volume_name': 'volume-7116fd84-464e-46d4-828d-654e18546886', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbb61647-78d3-417f-9474-5f21278e88bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbb61647-78d3-417f-9474-5f21278e88bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c86e8a3-24b3-4df9-9d5a-931f98b208e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:10 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] Volume 7116fd84-464e-46d4-828d-654e18546886: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7116fd84-464e-46d4-828d-654e18546886', 'volume_size': 1} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:10 devstack sudo[105043]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-a14d20ab-adaf-4867-b252-e16e382eef5a" returned: 0 in 0.284s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.749s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2132511109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d22de6-28c4-4b1d-b15d-bcb49d91a16b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eabf3d514504d73a62015d446b4d055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:07Z,use_quota=True,user_id='9901c1993c7d4ad1b9adea94fb56f10a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Creating volume e1d22de6-28c4-4b1d-b15d-bcb49d91a16b {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:51:10 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1d22de6-28c4-4b1d-b15d-bcb49d91a16b 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:10 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1d22de6-28c4-4b1d-b15d-bcb49d91a16b 1073741824 Sep 05 11:51:10 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42eec184-521d-4e27-84b8-a1344b91aab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a14d20ab-adaf-4867-b252-e16e382eef5a', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4352ea23-5bed-46de-a95a-9ea3d4355196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:10 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Volume volume-a14d20ab-adaf-4867-b252-e16e382eef5a (a14d20ab-adaf-4867-b252-e16e382eef5a): created successfully Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4352ea23-5bed-46de-a95a-9ea3d4355196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Flow 'volume_create_manager' (1920d4cf-08de-41a7-9716-5b1460bb8ed7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] Flow 'volume_create_manager' (ccaf4c5b-56ad-4d3a-9fd8-b9cc9b81b562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8118093-a7de-4474-8214-25a11248bdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:10 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ba967214-1d8d-4959-b832-343c710c057d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Created volume successfully. Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8118093-a7de-4474-8214-25a11248bdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1478676358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b2b7dd-1ee6-4bf8-8767-fbc9f92dd484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80f486c1b9145009e18c4b05525483e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:11Z,use_quota=True,user_id='2cbe8e88b4fc4d1aba9ef4b2684b2788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (444f94c1-a962-4bb5-8ac0-37592f614e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (444f94c1-a962-4bb5-8ac0-37592f614e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf112cb-bdb7-4d4a-9fe2-b231a6fb4302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf112cb-bdb7-4d4a-9fe2-b231a6fb4302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72b2b7dd-1ee6-4bf8-8767-fbc9f92dd484', 'volume_name': 'volume-72b2b7dd-1ee6-4bf8-8767-fbc9f92dd484', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5733c0fd-c583-465d-b76d-6ef4f4d7127b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5733c0fd-c583-465d-b76d-6ef4f4d7127b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a55bd9-9089-4850-a3ec-cc472ed51242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:10 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] Volume 72b2b7dd-1ee6-4bf8-8767-fbc9f92dd484: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72b2b7dd-1ee6-4bf8-8767-fbc9f92dd484', 'volume_size': 1} Sep 05 11:51:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] Flow 'volume_create_manager' (89c23a44-35e4-4389-ba39-110e8ad8de5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ad27b8-18cc-4fb2-9666-c7abb2eeefe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ad27b8-18cc-4fb2-9666-c7abb2eeefe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-521163977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a6c828-38e7-4e50-bcc2-10a548dfe466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80f486c1b9145009e18c4b05525483e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:11Z,use_quota=True,user_id='2cbe8e88b4fc4d1aba9ef4b2684b2788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4621e891-44e9-462a-bb3e-540205a160e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4621e891-44e9-462a-bb3e-540205a160e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d173853-c0c9-458c-8f78-2d00852cf3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d173853-c0c9-458c-8f78-2d00852cf3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85a6c828-38e7-4e50-bcc2-10a548dfe466', 'volume_name': 'volume-85a6c828-38e7-4e50-bcc2-10a548dfe466', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74777d0b-56b7-46f2-b89b-0c9416e8f2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74777d0b-56b7-46f2-b89b-0c9416e8f2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8758bc6e-147b-4155-be51-72c16c955838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:11 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] Volume 85a6c828-38e7-4e50-bcc2-10a548dfe466: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85a6c828-38e7-4e50-bcc2-10a548dfe466', 'volume_size': 1} Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:11 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1d22de6-28c4-4b1d-b15d-bcb49d91a16b 1073741824" returned: 0 in 0.526s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1d22de6-28c4-4b1d-b15d-bcb49d91a16b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:11 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1d22de6-28c4-4b1d-b15d-bcb49d91a16b Sep 05 11:51:11 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:11 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1d22de6-28c4-4b1d-b15d-bcb49d91a16b" returned: 0 in 0.247s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.156s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-101052289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ad47365-9908-4f3c-8a84-d64d6020132b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21538d62ca2a428f992d6377b3ae13f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:08Z,use_quota=True,user_id='74a06c104a864c7e91e4950ed800de92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] Creating volume 2ad47365-9908-4f3c-8a84-d64d6020132b {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:51:11 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2ad47365-9908-4f3c-8a84-d64d6020132b 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d38c38-d30e-45d9-9e18-b3eef5838ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1d22de6-28c4-4b1d-b15d-bcb49d91a16b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:11 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2ad47365-9908-4f3c-8a84-d64d6020132b 1073741824 Sep 05 11:51:11 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c39dab6-742d-4e56-9237-f5a9408b8491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:11 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Volume volume-e1d22de6-28c4-4b1d-b15d-bcb49d91a16b (e1d22de6-28c4-4b1d-b15d-bcb49d91a16b): created successfully Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c39dab6-742d-4e56-9237-f5a9408b8491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Flow 'volume_create_manager' (b020dcbc-1954-4d33-a1a0-9f927cb195b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:11 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-4a510520-0320-49c0-9af5-89a27069a1af tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Created volume successfully. Sep 05 11:51:11 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2ad47365-9908-4f3c-8a84-d64d6020132b 1073741824" returned: 0 in 0.412s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2ad47365-9908-4f3c-8a84-d64d6020132b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:12 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2ad47365-9908-4f3c-8a84-d64d6020132b Sep 05 11:51:12 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:12 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2ad47365-9908-4f3c-8a84-d64d6020132b" returned: 0 in 0.246s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.429s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4f3b3b0-988c-46b4-a0b8-c7f1964f7050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='238875811061458e8f9a403dc62b6734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:07Z,use_quota=True,user_id='b48d510b8c7a42d3ba410b025c5ee5d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(310eba9b-b82c-4f71-a242-6bd47ead1b9f),volume_type_id=310eba9b-b82c-4f71-a242-6bd47ead1b9f)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Creating volume e4f3b3b0-988c-46b4-a0b8-c7f1964f7050 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:51:12 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4f3b3b0-988c-46b4-a0b8-c7f1964f7050 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01530e0c-5511-4307-8ebf-7881b7e9856f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ad47365-9908-4f3c-8a84-d64d6020132b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d20ef50-61dd-4b84-9213-145c4a16f899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:12 devstack sudo[105065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4f3b3b0-988c-46b4-a0b8-c7f1964f7050 1073741824 Sep 05 11:51:12 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-16989df3-bd99-49cb-96f0-abe541907a5c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Acquiring lock "cinder-e1d22de6-28c4-4b1d-b15d-bcb49d91a16b-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:12 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] Volume volume-2ad47365-9908-4f3c-8a84-d64d6020132b (2ad47365-9908-4f3c-8a84-d64d6020132b): created successfully Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d20ef50-61dd-4b84-9213-145c4a16f899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] Flow 'volume_create_manager' (868b079a-264e-4bcb-8140-1bdd2d8dd8fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-16989df3-bd99-49cb-96f0-abe541907a5c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "cinder-e1d22de6-28c4-4b1d-b15d-bcb49d91a16b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:12 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-0000efad-3ce5-4d1c-81f4-231884779445 tempest-ProjectReaderTests-232353913 None] Created volume successfully. Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-16989df3-bd99-49cb-96f0-abe541907a5c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Acquiring lock "cinder-quobyte-e1d22de6-28c4-4b1d-b15d-bcb49d91a16b" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-16989df3-bd99-49cb-96f0-abe541907a5c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "cinder-quobyte-e1d22de6-28c4-4b1d-b15d-bcb49d91a16b" acquired by "delete_volume" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[10037b24-0c58-48d1-9b68-19320d7e844a]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-16989df3-bd99-49cb-96f0-abe541907a5c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1d22de6-28c4-4b1d-b15d-bcb49d91a16b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:12 devstack sudo[105067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1d22de6-28c4-4b1d-b15d-bcb49d91a16b Sep 05 11:51:12 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-cd931113-950a-460e-8033-36d445c9252c tempest-ProjectReaderTests-232353913 None] Acquiring lock "cinder-2ad47365-9908-4f3c-8a84-d64d6020132b-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-cd931113-950a-460e-8033-36d445c9252c tempest-ProjectReaderTests-232353913 None] Lock "cinder-2ad47365-9908-4f3c-8a84-d64d6020132b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-cd931113-950a-460e-8033-36d445c9252c tempest-ProjectReaderTests-232353913 None] Acquiring lock "cinder-quobyte-2ad47365-9908-4f3c-8a84-d64d6020132b" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-cd931113-950a-460e-8033-36d445c9252c tempest-ProjectReaderTests-232353913 None] Lock "cinder-quobyte-2ad47365-9908-4f3c-8a84-d64d6020132b" acquired by "delete_volume" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dee0ebc-96b3-4b54-bb21-63a431cf9075]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cd931113-950a-460e-8033-36d445c9252c tempest-ProjectReaderTests-232353913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2ad47365-9908-4f3c-8a84-d64d6020132b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:12 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4f3b3b0-988c-46b4-a0b8-c7f1964f7050 1073741824" returned: 0 in 0.517s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:12 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2ad47365-9908-4f3c-8a84-d64d6020132b Sep 05 11:51:12 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4f3b3b0-988c-46b4-a0b8-c7f1964f7050 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:12 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4f3b3b0-988c-46b4-a0b8-c7f1964f7050 Sep 05 11:51:12 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:12 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-16989df3-bd99-49cb-96f0-abe541907a5c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1d22de6-28c4-4b1d-b15d-bcb49d91a16b" returned: 0 in 0.447s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-16989df3-bd99-49cb-96f0-abe541907a5c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1d22de6-28c4-4b1d-b15d-bcb49d91a16b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:12 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1d22de6-28c4-4b1d-b15d-bcb49d91a16b Sep 05 11:51:12 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:13 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:13 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4f3b3b0-988c-46b4-a0b8-c7f1964f7050" returned: 0 in 0.270s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.408s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1128227738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20af6ddd-2df3-477f-8fec-52827627778a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80f486c1b9145009e18c4b05525483e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:10Z,use_quota=True,user_id='2cbe8e88b4fc4d1aba9ef4b2684b2788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] Creating volume 20af6ddd-2df3-477f-8fec-52827627778a {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:51:13 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20af6ddd-2df3-477f-8fec-52827627778a 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cd931113-950a-460e-8033-36d445c9252c tempest-ProjectReaderTests-232353913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2ad47365-9908-4f3c-8a84-d64d6020132b" returned: 0 in 0.443s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cd931113-950a-460e-8033-36d445c9252c tempest-ProjectReaderTests-232353913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2ad47365-9908-4f3c-8a84-d64d6020132b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:13 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20af6ddd-2df3-477f-8fec-52827627778a 1073741824 Sep 05 11:51:13 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:13 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:13 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2ad47365-9908-4f3c-8a84-d64d6020132b Sep 05 11:51:13 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Attempting download of 66ffaea9-8139-4958-991e-e0fbad45e7a6 ((None, [{'url': 'file:///opt/stack/data/glance/images/66ffaea9-8139-4958-991e-e0fbad45e7a6', 'metadata': {}}])) to volume e4f3b3b0-988c-46b4-a0b8-c7f1964f7050. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-16989df3-bd99-49cb-96f0-abe541907a5c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e1d22de6-28c4-4b1d-b15d-bcb49d91a16b" returned: 0 in 0.313s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-16989df3-bd99-49cb-96f0-abe541907a5c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "cinder-quobyte-e1d22de6-28c4-4b1d-b15d-bcb49d91a16b" released by "delete_volume" :: held 0.813s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4610b450-2af6-4b75-89d0-8bcce5195bc0]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_66ffaea9-8139-4958-991e-e0fbad45e7a6_l2prah7w {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-16989df3-bd99-49cb-96f0-abe541907a5c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Created reservations ['f04c1f59-3fa3-4bab-96f2-5f30a85101cc', 'e39ad64b-5eb1-4db0-9a4b-b908ba00846e', '12659a76-7d5e-40c3-b328-a14d024d0043', '272b184c-3be9-4b97-815b-bd0643b1db4f'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-16989df3-bd99-49cb-96f0-abe541907a5c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-16989df3-bd99-49cb-96f0-abe541907a5c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-16989df3-bd99-49cb-96f0-abe541907a5c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-16989df3-bd99-49cb-96f0-abe541907a5c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-16989df3-bd99-49cb-96f0-abe541907a5c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-16989df3-bd99-49cb-96f0-abe541907a5c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:13 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_66ffaea9-8139-4958-991e-e0fbad45e7a6_l2prah7w Sep 05 11:51:13 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:13 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:51:13 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:13 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cd931113-950a-460e-8033-36d445c9252c tempest-ProjectReaderTests-232353913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2ad47365-9908-4f3c-8a84-d64d6020132b" returned: 0 in 0.334s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-cd931113-950a-460e-8033-36d445c9252c tempest-ProjectReaderTests-232353913 None] Lock "cinder-quobyte-2ad47365-9908-4f3c-8a84-d64d6020132b" released by "delete_volume" :: held 0.831s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-37122174-d475-4fce-b27c-96d0680526df tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Acquiring lock "cinder-a14d20ab-adaf-4867-b252-e16e382eef5a-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-cd931113-950a-460e-8033-36d445c9252c tempest-ProjectReaderTests-232353913 None] Created reservations ['7ddcb3a3-b3b8-4580-9265-ee8dc9a36793', '031f8a90-c4df-46e8-96fe-f00da44e2f22', 'f731a0ee-cbf6-494a-808f-24b2c4551a31', '8804d482-243a-4161-b445-c2c6968c3576'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-37122174-d475-4fce-b27c-96d0680526df tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "cinder-a14d20ab-adaf-4867-b252-e16e382eef5a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:13 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_66ffaea9-8139-4958-991e-e0fbad45e7a6_l2prah7w" returned: 0 in 0.433s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_66ffaea9-8139-4958-991e-e0fbad45e7a6_l2prah7w {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:13 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:13 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-37122174-d475-4fce-b27c-96d0680526df tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Acquiring lock "cinder-quobyte-a14d20ab-adaf-4867-b252-e16e382eef5a" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20af6ddd-2df3-477f-8fec-52827627778a 1073741824" returned: 0 in 0.641s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-16989df3-bd99-49cb-96f0-abe541907a5c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.386s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-16989df3-bd99-49cb-96f0-abe541907a5c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:51:13 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-16989df3-bd99-49cb-96f0-abe541907a5c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Deleted volume successfully. Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-37122174-d475-4fce-b27c-96d0680526df tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "cinder-quobyte-a14d20ab-adaf-4867-b252-e16e382eef5a" acquired by "delete_volume" :: waited 0.042s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e765960a-8deb-472a-b164-b626b19e87be]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-37122174-d475-4fce-b27c-96d0680526df tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-a14d20ab-adaf-4867-b252-e16e382eef5a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:13 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_66ffaea9-8139-4958-991e-e0fbad45e7a6_l2prah7w Sep 05 11:51:13 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cd931113-950a-460e-8033-36d445c9252c tempest-ProjectReaderTests-232353913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cd931113-950a-460e-8033-36d445c9252c tempest-ProjectReaderTests-232353913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cd931113-950a-460e-8033-36d445c9252c tempest-ProjectReaderTests-232353913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-cd931113-950a-460e-8033-36d445c9252c tempest-ProjectReaderTests-232353913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-cd931113-950a-460e-8033-36d445c9252c tempest-ProjectReaderTests-232353913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cd931113-950a-460e-8033-36d445c9252c tempest-ProjectReaderTests-232353913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-16989df3-bd99-49cb-96f0-abe541907a5c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "cinder-e1d22de6-28c4-4b1d-b15d-bcb49d91a16b-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20af6ddd-2df3-477f-8fec-52827627778a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:13 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:51:13 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:13 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20af6ddd-2df3-477f-8fec-52827627778a Sep 05 11:51:13 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:13 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-a14d20ab-adaf-4867-b252-e16e382eef5a Sep 05 11:51:13 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:14 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_66ffaea9-8139-4958-991e-e0fbad45e7a6_l2prah7w" returned: 1 in 0.429s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_66ffaea9-8139-4958-991e-e0fbad45e7a6_l2prah7w' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c52dd0e-fd08-405e-8e89-8faec6e11352]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66ffaea9-8139-4958-991e-e0fbad45e7a6__5cy1up1devstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:14 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20af6ddd-2df3-477f-8fec-52827627778a" returned: 0 in 0.261s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:14 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.023s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1487017150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb70f019-4371-422b-b637-e252dc78737e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80f486c1b9145009e18c4b05525483e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:10Z,use_quota=True,user_id='2cbe8e88b4fc4d1aba9ef4b2684b2788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] Creating volume eb70f019-4371-422b-b637-e252dc78737e {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:51:14 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eb70f019-4371-422b-b637-e252dc78737e 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-cd931113-950a-460e-8033-36d445c9252c tempest-ProjectReaderTests-232353913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.335s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-cd931113-950a-460e-8033-36d445c9252c tempest-ProjectReaderTests-232353913 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:51:14 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-cd931113-950a-460e-8033-36d445c9252c tempest-ProjectReaderTests-232353913 None] Deleted volume successfully. Sep 05 11:51:14 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eb70f019-4371-422b-b637-e252dc78737e 1073741824 Sep 05 11:51:14 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2f5e4df-5020-451d-a328-d4847e06342f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20af6ddd-2df3-477f-8fec-52827627778a', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8e603c3-edd3-490e-8024-437bee39a6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:14 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] Volume volume-20af6ddd-2df3-477f-8fec-52827627778a (20af6ddd-2df3-477f-8fec-52827627778a): created successfully Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8e603c3-edd3-490e-8024-437bee39a6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:14 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66ffaea9-8139-4958-991e-e0fbad45e7a6__5cy1up1devstack@QuobyteHD Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] Flow 'volume_create_manager' (9b06d16f-4314-43cc-a3f9-c61e722bf329) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:14 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-cd931113-950a-460e-8033-36d445c9252c tempest-ProjectReaderTests-232353913 None] Lock "cinder-2ad47365-9908-4f3c-8a84-d64d6020132b-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:14 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-38511e07-9a53-4ec2-9efa-af3cedbe1432 tempest-CreateVolumesFromSnapshotTest-542375037 None] Created volume successfully. Sep 05 11:51:14 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-37122174-d475-4fce-b27c-96d0680526df tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-a14d20ab-adaf-4867-b252-e16e382eef5a" returned: 0 in 0.469s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-37122174-d475-4fce-b27c-96d0680526df tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-a14d20ab-adaf-4867-b252-e16e382eef5a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:14 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-a14d20ab-adaf-4867-b252-e16e382eef5a Sep 05 11:51:14 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:14 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66ffaea9-8139-4958-991e-e0fbad45e7a6__5cy1up1devstack@QuobyteHD" returned: 0 in 0.375s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66ffaea9-8139-4958-991e-e0fbad45e7a6__5cy1up1devstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:14 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-37122174-d475-4fce-b27c-96d0680526df tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-a14d20ab-adaf-4867-b252-e16e382eef5a" returned: 0 in 0.269s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-37122174-d475-4fce-b27c-96d0680526df tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "cinder-quobyte-a14d20ab-adaf-4867-b252-e16e382eef5a" released by "delete_volume" :: held 0.787s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:14 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66ffaea9-8139-4958-991e-e0fbad45e7a6__5cy1up1devstack@QuobyteHD Sep 05 11:51:14 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-37122174-d475-4fce-b27c-96d0680526df tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Created reservations ['0f157c95-6465-496f-8d96-86c237a48822', '4e0fa010-d565-4932-8afe-99ed3470d518', '40643d7b-79bd-4687-919c-0a5f0f66dd12', '1072a0f4-a451-40d4-8dcd-cdc4fdc8df11'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-37122174-d475-4fce-b27c-96d0680526df tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-37122174-d475-4fce-b27c-96d0680526df tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-37122174-d475-4fce-b27c-96d0680526df tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-37122174-d475-4fce-b27c-96d0680526df tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-37122174-d475-4fce-b27c-96d0680526df tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-37122174-d475-4fce-b27c-96d0680526df tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:14 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eb70f019-4371-422b-b637-e252dc78737e 1073741824" returned: 0 in 0.605s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:14 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:51:14 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eb70f019-4371-422b-b637-e252dc78737e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-61d1ae49-5d4e-4735-9559-a9b180477b8a tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Acquiring lock "cinder-63d85bb5-d58a-4bcf-8398-7024d0c7b725-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:14 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eb70f019-4371-422b-b637-e252dc78737e Sep 05 11:51:14 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-61d1ae49-5d4e-4735-9559-a9b180477b8a tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "cinder-63d85bb5-d58a-4bcf-8398-7024d0c7b725-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-61d1ae49-5d4e-4735-9559-a9b180477b8a tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Acquiring lock "cinder-quobyte-63d85bb5-d58a-4bcf-8398-7024d0c7b725" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-61d1ae49-5d4e-4735-9559-a9b180477b8a tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "cinder-quobyte-63d85bb5-d58a-4bcf-8398-7024d0c7b725" acquired by "delete_volume" :: waited 0.028s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:14 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66ffaea9-8139-4958-991e-e0fbad45e7a6__5cy1up1devstack@QuobyteHD" returned: 1 in 0.530s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66ffaea9-8139-4958-991e-e0fbad45e7a6__5cy1up1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 11:51:14 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] 66ffaea9-8139-4958-991e-e0fbad45e7a6 was raw, converting to qcow2 {{(pid=87517) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 11:51:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_66ffaea9-8139-4958-991e-e0fbad45e7a6__5cy1up1devstack@QuobyteHD /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4f3b3b0-988c-46b4-a0b8-c7f1964f7050 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:15 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b9b6e0-8b3a-4ef3-a1b3-f143ee1aa9f6]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-61d1ae49-5d4e-4735-9559-a9b180477b8a tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-63d85bb5-d58a-4bcf-8398-7024d0c7b725 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:15 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_66ffaea9-8139-4958-991e-e0fbad45e7a6__5cy1up1devstack@QuobyteHD /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4f3b3b0-988c-46b4-a0b8-c7f1964f7050 Sep 05 11:51:15 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:15 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-37122174-d475-4fce-b27c-96d0680526df tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.380s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:15 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-37122174-d475-4fce-b27c-96d0680526df tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:51:15 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-37122174-d475-4fce-b27c-96d0680526df tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Deleted volume successfully. Sep 05 11:51:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-37122174-d475-4fce-b27c-96d0680526df tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "cinder-a14d20ab-adaf-4867-b252-e16e382eef5a-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:15 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-63d85bb5-d58a-4bcf-8398-7024d0c7b725 Sep 05 11:51:15 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:15 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eb70f019-4371-422b-b637-e252dc78737e" returned: 0 in 0.408s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:51:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.693s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1736237287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7116fd84-464e-46d4-828d-654e18546886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80f486c1b9145009e18c4b05525483e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:10Z,use_quota=True,user_id='2cbe8e88b4fc4d1aba9ef4b2684b2788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:51:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] Creating volume 7116fd84-464e-46d4-828d-654e18546886 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:51:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:51:15 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:51:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7116fd84-464e-46d4-828d-654e18546886 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c6a12a5-32a4-40be-b067-471f7afd0b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb70f019-4371-422b-b637-e252dc78737e', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff48cf9-5ced-4ceb-855b-484e83b01452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:15 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] Volume volume-eb70f019-4371-422b-b637-e252dc78737e (eb70f019-4371-422b-b637-e252dc78737e): created successfully Sep 05 11:51:15 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7116fd84-464e-46d4-828d-654e18546886 1073741824 Sep 05 11:51:15 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff48cf9-5ced-4ceb-855b-484e83b01452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:15 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] Flow 'volume_create_manager' (ae8ec327-cd07-44c6-a0ca-6afd538bd0fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:15 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-86bd15c3-15d6-4025-ae82-b68e9b80e161 tempest-CreateVolumesFromSnapshotTest-542375037 None] Created volume successfully. Sep 05 11:51:15 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-61d1ae49-5d4e-4735-9559-a9b180477b8a tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-63d85bb5-d58a-4bcf-8398-7024d0c7b725" returned: 0 in 0.564s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-61d1ae49-5d4e-4735-9559-a9b180477b8a tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-63d85bb5-d58a-4bcf-8398-7024d0c7b725 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:15 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-63d85bb5-d58a-4bcf-8398-7024d0c7b725 Sep 05 11:51:15 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:15 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_66ffaea9-8139-4958-991e-e0fbad45e7a6__5cy1up1devstack@QuobyteHD /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4f3b3b0-988c-46b4-a0b8-c7f1964f7050" returned: 0 in 0.729s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:15 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_66ffaea9-8139-4958-991e-e0fbad45e7a6__5cy1up1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4f3b3b0-988c-46b4-a0b8-c7f1964f7050 {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 11:51:15 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Converted 0.00 MB image at 0.00 MB/s Sep 05 11:51:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4f3b3b0-988c-46b4-a0b8-c7f1964f7050 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:15 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4f3b3b0-988c-46b4-a0b8-c7f1964f7050 1G Sep 05 11:51:15 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:15 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7116fd84-464e-46d4-828d-654e18546886 1073741824" returned: 0 in 0.645s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:15 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-61d1ae49-5d4e-4735-9559-a9b180477b8a tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-63d85bb5-d58a-4bcf-8398-7024d0c7b725" returned: 0 in 0.296s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-61d1ae49-5d4e-4735-9559-a9b180477b8a tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "cinder-quobyte-63d85bb5-d58a-4bcf-8398-7024d0c7b725" released by "delete_volume" :: held 0.941s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7116fd84-464e-46d4-828d-654e18546886 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:15 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7116fd84-464e-46d4-828d-654e18546886 Sep 05 11:51:15 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-61d1ae49-5d4e-4735-9559-a9b180477b8a tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Created reservations ['1507156e-7317-4661-befa-ef658670ff07', 'b3efb1fc-4a6b-4b3a-ae6c-001d23f2fae9', '573428e7-69da-4191-975f-8ff7fa1620e0', '09547007-9bfe-4183-bf8b-20c2a55c53be'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-61d1ae49-5d4e-4735-9559-a9b180477b8a tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-61d1ae49-5d4e-4735-9559-a9b180477b8a tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-61d1ae49-5d4e-4735-9559-a9b180477b8a tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-61d1ae49-5d4e-4735-9559-a9b180477b8a tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-61d1ae49-5d4e-4735-9559-a9b180477b8a tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-61d1ae49-5d4e-4735-9559-a9b180477b8a tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:16 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:51:16 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:16 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4f3b3b0-988c-46b4-a0b8-c7f1964f7050 1G" returned: 0 in 0.466s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Downloaded image 66ffaea9-8139-4958-991e-e0fbad45e7a6 ((None, [{'url': 'file:///opt/stack/data/glance/images/66ffaea9-8139-4958-991e-e0fbad45e7a6', 'metadata': {}}])) to volume e4f3b3b0-988c-46b4-a0b8-c7f1964f7050 successfully. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Temporary image 66ffaea9-8139-4958-991e-e0fbad45e7a6 for user b48d510b8c7a42d3ba410b025c5ee5d2 is deleted. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Marking volume e4f3b3b0-988c-46b4-a0b8-c7f1964f7050 as bootable. {{(pid=87517) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Copying metadata from image 66ffaea9-8139-4958-991e-e0fbad45e7a6 to e4f3b3b0-988c-46b4-a0b8-c7f1964f7050. {{(pid=87517) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Creating volume glance metadata for volume e4f3b3b0-988c-46b4-a0b8-c7f1964f7050 backed by image 66ffaea9-8139-4958-991e-e0fbad45e7a6 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '66ffaea9-8139-4958-991e-e0fbad45e7a6', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '9923924f79c778248cb7be7eb5022340', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87517) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 11:51:16 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7116fd84-464e-46d4-828d-654e18546886" returned: 0 in 0.352s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.364s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1478676358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b2b7dd-1ee6-4bf8-8767-fbc9f92dd484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80f486c1b9145009e18c4b05525483e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:11Z,use_quota=True,user_id='2cbe8e88b4fc4d1aba9ef4b2684b2788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] Creating volume 72b2b7dd-1ee6-4bf8-8767-fbc9f92dd484 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:51:16 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-72b2b7dd-1ee6-4bf8-8767-fbc9f92dd484 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c86e8a3-24b3-4df9-9d5a-931f98b208e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7116fd84-464e-46d4-828d-654e18546886', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b58c885-aa67-4773-ab25-40e17bc70063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:16 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-72b2b7dd-1ee6-4bf8-8767-fbc9f92dd484 1073741824 Sep 05 11:51:16 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:16 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] Volume volume-7116fd84-464e-46d4-828d-654e18546886 (7116fd84-464e-46d4-828d-654e18546886): created successfully Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b58c885-aa67-4773-ab25-40e17bc70063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] Flow 'volume_create_manager' (ec7c3d5c-315b-404f-aec7-fa7c1288fd9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21af5da6-d8cf-4e36-b2f5-b85ec00ae42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4f3b3b0-988c-46b4-a0b8-c7f1964f7050', 'volume_size': 1, 'image_id': '66ffaea9-8139-4958-991e-e0fbad45e7a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/66ffaea9-8139-4958-991e-e0fbad45e7a6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9923924f79c778248cb7be7eb5022340', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '238875811061458e8f9a403dc62b6734', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '22b7e3f48cf5f10010ea469cd820e94cc4e2b6531f1ea1dabe015679c02447d0fc556ea38c4605f1206181837862a183febfe1f2d3a20e5eb2bb6eae845c25df', 'id': '66ffaea9-8139-4958-991e-e0fbad45e7a6', 'created_at': datetime.datetime(2026, 9, 5, 9, 51, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 9, 51, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/66ffaea9-8139-4958-991e-e0fbad45e7a6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea60b4ee-7192-45d1-86cb-6fdf99536c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:16 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Volume volume-e4f3b3b0-988c-46b4-a0b8-c7f1964f7050 (e4f3b3b0-988c-46b4-a0b8-c7f1964f7050): created successfully Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea60b4ee-7192-45d1-86cb-6fdf99536c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Flow 'volume_create_manager' (4d67a910-99f6-448f-a243-c1e60b2a7b6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:16 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-57439f60-bad3-4971-84fa-9f5d071364d2 tempest-CreateVolumesFromSnapshotTest-542375037 None] Created volume successfully. Sep 05 11:51:16 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f1bb6c52-1c35-4e44-8fef-e64b11c02531 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Created volume successfully. Sep 05 11:51:16 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-61d1ae49-5d4e-4735-9559-a9b180477b8a tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.356s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-61d1ae49-5d4e-4735-9559-a9b180477b8a tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:51:16 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-61d1ae49-5d4e-4735-9559-a9b180477b8a tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Deleted volume successfully. Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-61d1ae49-5d4e-4735-9559-a9b180477b8a tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "cinder-63d85bb5-d58a-4bcf-8398-7024d0c7b725-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:16 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-72b2b7dd-1ee6-4bf8-8767-fbc9f92dd484 1073741824" returned: 0 in 0.517s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-72b2b7dd-1ee6-4bf8-8767-fbc9f92dd484 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:16 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-72b2b7dd-1ee6-4bf8-8767-fbc9f92dd484 Sep 05 11:51:16 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:17 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b6cfad83-4ae8-4a44-b56a-905c38333d7d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Acquiring lock "cinder-67d6d8c3-927b-4438-a947-9e69c2a1cab6-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-72b2b7dd-1ee6-4bf8-8767-fbc9f92dd484" returned: 0 in 0.270s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.923s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-521163977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a6c828-38e7-4e50-bcc2-10a548dfe466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80f486c1b9145009e18c4b05525483e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:11Z,use_quota=True,user_id='2cbe8e88b4fc4d1aba9ef4b2684b2788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] Creating volume 85a6c828-38e7-4e50-bcc2-10a548dfe466 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:51:17 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85a6c828-38e7-4e50-bcc2-10a548dfe466 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:17 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85a6c828-38e7-4e50-bcc2-10a548dfe466 1073741824 Sep 05 11:51:17 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a55bd9-9089-4850-a3ec-cc472ed51242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72b2b7dd-1ee6-4bf8-8767-fbc9f92dd484', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c838ba9-3f3e-4400-a470-2273247d52d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b6cfad83-4ae8-4a44-b56a-905c38333d7d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "cinder-67d6d8c3-927b-4438-a947-9e69c2a1cab6-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:17 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] Volume volume-72b2b7dd-1ee6-4bf8-8767-fbc9f92dd484 (72b2b7dd-1ee6-4bf8-8767-fbc9f92dd484): created successfully Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c838ba9-3f3e-4400-a470-2273247d52d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] Flow 'volume_create_manager' (ccaf4c5b-56ad-4d3a-9fd8-b9cc9b81b562) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:17 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-62db7d6f-3bed-4d3a-920e-ea3880030851 tempest-CreateVolumesFromSnapshotTest-542375037 None] Created volume successfully. Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b6cfad83-4ae8-4a44-b56a-905c38333d7d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Acquiring lock "cinder-quobyte-67d6d8c3-927b-4438-a947-9e69c2a1cab6" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b6cfad83-4ae8-4a44-b56a-905c38333d7d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "cinder-quobyte-67d6d8c3-927b-4438-a947-9e69c2a1cab6" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-afa795e5-bdc1-4f0d-9574-09cae5ab4a92 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Acquiring lock "cinder-e4f3b3b0-988c-46b4-a0b8-c7f1964f7050-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c8b615-dd75-4719-8a0a-65d545d9d909]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b6cfad83-4ae8-4a44-b56a-905c38333d7d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67d6d8c3-927b-4438-a947-9e69c2a1cab6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-afa795e5-bdc1-4f0d-9574-09cae5ab4a92 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Lock "cinder-e4f3b3b0-988c-46b4-a0b8-c7f1964f7050-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-afa795e5-bdc1-4f0d-9574-09cae5ab4a92 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Acquiring lock "cinder-quobyte-e4f3b3b0-988c-46b4-a0b8-c7f1964f7050" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-afa795e5-bdc1-4f0d-9574-09cae5ab4a92 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Lock "cinder-quobyte-e4f3b3b0-988c-46b4-a0b8-c7f1964f7050" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[383d3a27-8fb7-40f6-a85f-a922b653d013]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-afa795e5-bdc1-4f0d-9574-09cae5ab4a92 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4f3b3b0-988c-46b4-a0b8-c7f1964f7050 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:17 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67d6d8c3-927b-4438-a947-9e69c2a1cab6 Sep 05 11:51:17 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:17 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4f3b3b0-988c-46b4-a0b8-c7f1964f7050 Sep 05 11:51:17 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:17 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85a6c828-38e7-4e50-bcc2-10a548dfe466 1073741824" returned: 0 in 0.537s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85a6c828-38e7-4e50-bcc2-10a548dfe466 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:17 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85a6c828-38e7-4e50-bcc2-10a548dfe466 Sep 05 11:51:17 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:17 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b6cfad83-4ae8-4a44-b56a-905c38333d7d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67d6d8c3-927b-4438-a947-9e69c2a1cab6" returned: 0 in 0.486s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b6cfad83-4ae8-4a44-b56a-905c38333d7d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67d6d8c3-927b-4438-a947-9e69c2a1cab6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:17 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67d6d8c3-927b-4438-a947-9e69c2a1cab6 Sep 05 11:51:17 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:17 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-afa795e5-bdc1-4f0d-9574-09cae5ab4a92 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4f3b3b0-988c-46b4-a0b8-c7f1964f7050" returned: 0 in 0.470s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-afa795e5-bdc1-4f0d-9574-09cae5ab4a92 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4f3b3b0-988c-46b4-a0b8-c7f1964f7050 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:17 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4f3b3b0-988c-46b4-a0b8-c7f1964f7050 Sep 05 11:51:18 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:18 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85a6c828-38e7-4e50-bcc2-10a548dfe466" returned: 0 in 0.340s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:51:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8758bc6e-147b-4155-be51-72c16c955838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85a6c828-38e7-4e50-bcc2-10a548dfe466', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (525432d6-c334-4553-9244-5382e42ad1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:18 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] Volume volume-85a6c828-38e7-4e50-bcc2-10a548dfe466 (85a6c828-38e7-4e50-bcc2-10a548dfe466): created successfully Sep 05 11:51:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (525432d6-c334-4553-9244-5382e42ad1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] Flow 'volume_create_manager' (89c23a44-35e4-4389-ba39-110e8ad8de5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:18 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b6cfad83-4ae8-4a44-b56a-905c38333d7d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-67d6d8c3-927b-4438-a947-9e69c2a1cab6" returned: 0 in 0.298s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b6cfad83-4ae8-4a44-b56a-905c38333d7d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "cinder-quobyte-67d6d8c3-927b-4438-a947-9e69c2a1cab6" released by "delete_volume" :: held 0.854s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:18 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2ee4f400-17b0-459d-be1d-277df242d270 tempest-CreateVolumesFromSnapshotTest-542375037 None] Created volume successfully. Sep 05 11:51:18 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-b6cfad83-4ae8-4a44-b56a-905c38333d7d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Created reservations ['d869210e-04ae-4575-9c54-518732629147', 'ab81a253-836a-43e1-bd54-d06ecc5cb08a', 'bef3f4ef-e1ac-43dc-a996-1641a18dfbc5', '59e12dfb-8524-423b-9eb4-2591d2916513'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:51:18 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-afa795e5-bdc1-4f0d-9574-09cae5ab4a92 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-e4f3b3b0-988c-46b4-a0b8-c7f1964f7050" returned: 0 in 0.305s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-afa795e5-bdc1-4f0d-9574-09cae5ab4a92 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Lock "cinder-quobyte-e4f3b3b0-988c-46b4-a0b8-c7f1964f7050" released by "delete_volume" :: held 0.823s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b6cfad83-4ae8-4a44-b56a-905c38333d7d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b6cfad83-4ae8-4a44-b56a-905c38333d7d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b6cfad83-4ae8-4a44-b56a-905c38333d7d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b6cfad83-4ae8-4a44-b56a-905c38333d7d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b6cfad83-4ae8-4a44-b56a-905c38333d7d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b6cfad83-4ae8-4a44-b56a-905c38333d7d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:18 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-afa795e5-bdc1-4f0d-9574-09cae5ab4a92 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Created reservations ['d801ecb9-7b19-465d-b13c-c91b8f8b42b4', '50291179-1c94-41b8-9bc4-8738561a7515', '13fd27b9-aa3e-4cf8-829e-716b9ac1c862', 'df5c11bf-ae9e-42e8-9a10-d630905dcaa4'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:51:18 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:51:18 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-afa795e5-bdc1-4f0d-9574-09cae5ab4a92 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-afa795e5-bdc1-4f0d-9574-09cae5ab4a92 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-afa795e5-bdc1-4f0d-9574-09cae5ab4a92 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-afa795e5-bdc1-4f0d-9574-09cae5ab4a92 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-afa795e5-bdc1-4f0d-9574-09cae5ab4a92 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-afa795e5-bdc1-4f0d-9574-09cae5ab4a92 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:18 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:51:18 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:18 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b6cfad83-4ae8-4a44-b56a-905c38333d7d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.279s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:18 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-b6cfad83-4ae8-4a44-b56a-905c38333d7d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:51:18 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b6cfad83-4ae8-4a44-b56a-905c38333d7d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Deleted volume successfully. Sep 05 11:51:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b6cfad83-4ae8-4a44-b56a-905c38333d7d tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "cinder-67d6d8c3-927b-4438-a947-9e69c2a1cab6-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:18 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-afa795e5-bdc1-4f0d-9574-09cae5ab4a92 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.333s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:18 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-afa795e5-bdc1-4f0d-9574-09cae5ab4a92 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:51:18 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-afa795e5-bdc1-4f0d-9574-09cae5ab4a92 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Deleted volume successfully. Sep 05 11:51:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-afa795e5-bdc1-4f0d-9574-09cae5ab4a92 tempest-VolumeAndVolumeTypeFromImageTest-1761156751 None] Lock "cinder-e4f3b3b0-988c-46b4-a0b8-c7f1964f7050-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-42a3f0e7-01d1-4abf-aea0-34c3b2eed017 tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "cinder-85a6c828-38e7-4e50-bcc2-10a548dfe466-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-42a3f0e7-01d1-4abf-aea0-34c3b2eed017 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "cinder-85a6c828-38e7-4e50-bcc2-10a548dfe466-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-42a3f0e7-01d1-4abf-aea0-34c3b2eed017 tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "cinder-quobyte-85a6c828-38e7-4e50-bcc2-10a548dfe466" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-42a3f0e7-01d1-4abf-aea0-34c3b2eed017 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "cinder-quobyte-85a6c828-38e7-4e50-bcc2-10a548dfe466" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:19 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bbe524-7e21-4f47-b3c6-36806084fa0f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-42a3f0e7-01d1-4abf-aea0-34c3b2eed017 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85a6c828-38e7-4e50-bcc2-10a548dfe466 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:19 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85a6c828-38e7-4e50-bcc2-10a548dfe466 Sep 05 11:51:19 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-15c77b04-b4ad-46ba-a333-75849da7ff1c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Acquiring lock "cinder-6ecbbe60-23be-46f3-a7f9-dd53ab929358-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-15c77b04-b4ad-46ba-a333-75849da7ff1c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "cinder-6ecbbe60-23be-46f3-a7f9-dd53ab929358-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-15c77b04-b4ad-46ba-a333-75849da7ff1c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Acquiring lock "cinder-quobyte-6ecbbe60-23be-46f3-a7f9-dd53ab929358" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-15c77b04-b4ad-46ba-a333-75849da7ff1c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "cinder-quobyte-6ecbbe60-23be-46f3-a7f9-dd53ab929358" acquired by "delete_volume" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:19 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1994330-9b2b-4569-aa7f-f6c0260c256d]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:19 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-15c77b04-b4ad-46ba-a333-75849da7ff1c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6ecbbe60-23be-46f3-a7f9-dd53ab929358 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-42a3f0e7-01d1-4abf-aea0-34c3b2eed017 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85a6c828-38e7-4e50-bcc2-10a548dfe466" returned: 0 in 0.450s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-42a3f0e7-01d1-4abf-aea0-34c3b2eed017 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85a6c828-38e7-4e50-bcc2-10a548dfe466 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:19 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85a6c828-38e7-4e50-bcc2-10a548dfe466 Sep 05 11:51:19 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:19 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6ecbbe60-23be-46f3-a7f9-dd53ab929358 Sep 05 11:51:19 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:19 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-42a3f0e7-01d1-4abf-aea0-34c3b2eed017 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-85a6c828-38e7-4e50-bcc2-10a548dfe466" returned: 0 in 0.324s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-42a3f0e7-01d1-4abf-aea0-34c3b2eed017 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "cinder-quobyte-85a6c828-38e7-4e50-bcc2-10a548dfe466" released by "delete_volume" :: held 0.825s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:19 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-42a3f0e7-01d1-4abf-aea0-34c3b2eed017 tempest-CreateVolumesFromSnapshotTest-542375037 None] Created reservations ['40e28e47-e19a-458a-9128-a5212ddf84d3', '1f4b80b3-4b27-406c-b9c5-9b3cefb5bb78', '9b5c3612-2705-43e6-8f4f-e8c765ecaed5', 'dd328974-b10f-4b49-899a-a026dc7304fd'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:51:20 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-15c77b04-b4ad-46ba-a333-75849da7ff1c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6ecbbe60-23be-46f3-a7f9-dd53ab929358" returned: 0 in 0.495s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-15c77b04-b4ad-46ba-a333-75849da7ff1c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6ecbbe60-23be-46f3-a7f9-dd53ab929358 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:20 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6ecbbe60-23be-46f3-a7f9-dd53ab929358 Sep 05 11:51:20 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-42a3f0e7-01d1-4abf-aea0-34c3b2eed017 tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-42a3f0e7-01d1-4abf-aea0-34c3b2eed017 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-42a3f0e7-01d1-4abf-aea0-34c3b2eed017 tempest-CreateVolumesFromSnapshotTest-542375037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-42a3f0e7-01d1-4abf-aea0-34c3b2eed017 tempest-CreateVolumesFromSnapshotTest-542375037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-42a3f0e7-01d1-4abf-aea0-34c3b2eed017 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-42a3f0e7-01d1-4abf-aea0-34c3b2eed017 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:20 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:51:20 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-563b95e0-0403-4de8-b7af-b84284d08b55 tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "cinder-72b2b7dd-1ee6-4bf8-8767-fbc9f92dd484-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-563b95e0-0403-4de8-b7af-b84284d08b55 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "cinder-72b2b7dd-1ee6-4bf8-8767-fbc9f92dd484-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-563b95e0-0403-4de8-b7af-b84284d08b55 tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "cinder-quobyte-72b2b7dd-1ee6-4bf8-8767-fbc9f92dd484" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-563b95e0-0403-4de8-b7af-b84284d08b55 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "cinder-quobyte-72b2b7dd-1ee6-4bf8-8767-fbc9f92dd484" acquired by "delete_volume" :: waited 0.022s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:20 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a28739-f8dd-4359-9f16-cacd3d741216]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-563b95e0-0403-4de8-b7af-b84284d08b55 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-72b2b7dd-1ee6-4bf8-8767-fbc9f92dd484 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:20 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-15c77b04-b4ad-46ba-a333-75849da7ff1c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6ecbbe60-23be-46f3-a7f9-dd53ab929358" returned: 0 in 0.462s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:20 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-15c77b04-b4ad-46ba-a333-75849da7ff1c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "cinder-quobyte-6ecbbe60-23be-46f3-a7f9-dd53ab929358" released by "delete_volume" :: held 1.025s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-42a3f0e7-01d1-4abf-aea0-34c3b2eed017 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.439s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:20 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-42a3f0e7-01d1-4abf-aea0-34c3b2eed017 tempest-CreateVolumesFromSnapshotTest-542375037 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:51:20 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-42a3f0e7-01d1-4abf-aea0-34c3b2eed017 tempest-CreateVolumesFromSnapshotTest-542375037 None] Deleted volume successfully. Sep 05 11:51:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-42a3f0e7-01d1-4abf-aea0-34c3b2eed017 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "cinder-85a6c828-38e7-4e50-bcc2-10a548dfe466-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:20 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-72b2b7dd-1ee6-4bf8-8767-fbc9f92dd484 Sep 05 11:51:20 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:20 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-15c77b04-b4ad-46ba-a333-75849da7ff1c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Created reservations ['84c7f840-7b1d-4194-98c3-bb1d2a1ddf4d', 'f0651481-26b8-4966-bd0f-1f910656ff26', 'a84e6578-46a1-41dc-9ec7-fd5cbf45bda7', '74b4158b-a34f-4db5-8aad-bf4cf6a4574c'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:51:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-15c77b04-b4ad-46ba-a333-75849da7ff1c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-15c77b04-b4ad-46ba-a333-75849da7ff1c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-15c77b04-b4ad-46ba-a333-75849da7ff1c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-15c77b04-b4ad-46ba-a333-75849da7ff1c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-15c77b04-b4ad-46ba-a333-75849da7ff1c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-15c77b04-b4ad-46ba-a333-75849da7ff1c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:20 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:51:20 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:20 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-563b95e0-0403-4de8-b7af-b84284d08b55 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-72b2b7dd-1ee6-4bf8-8767-fbc9f92dd484" returned: 0 in 0.528s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-563b95e0-0403-4de8-b7af-b84284d08b55 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-72b2b7dd-1ee6-4bf8-8767-fbc9f92dd484 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:21 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-72b2b7dd-1ee6-4bf8-8767-fbc9f92dd484 Sep 05 11:51:21 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:21 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-15c77b04-b4ad-46ba-a333-75849da7ff1c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.357s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:21 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-15c77b04-b4ad-46ba-a333-75849da7ff1c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:51:21 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-15c77b04-b4ad-46ba-a333-75849da7ff1c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Deleted volume successfully. Sep 05 11:51:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-15c77b04-b4ad-46ba-a333-75849da7ff1c tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "cinder-6ecbbe60-23be-46f3-a7f9-dd53ab929358-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:21 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-563b95e0-0403-4de8-b7af-b84284d08b55 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-72b2b7dd-1ee6-4bf8-8767-fbc9f92dd484" returned: 0 in 0.290s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-563b95e0-0403-4de8-b7af-b84284d08b55 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "cinder-quobyte-72b2b7dd-1ee6-4bf8-8767-fbc9f92dd484" released by "delete_volume" :: held 0.881s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:21 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-563b95e0-0403-4de8-b7af-b84284d08b55 tempest-CreateVolumesFromSnapshotTest-542375037 None] Created reservations ['40cfa3ee-6d48-4786-b1d8-ca51c1a98661', 'f9427f0c-043f-493a-b50a-c80789b7cf1a', '3ef8a150-62e7-4743-b3fc-e9407bec8aa0', 'ce9eec75-07d7-4e7f-9bde-dcc7d17fead0'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:51:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-563b95e0-0403-4de8-b7af-b84284d08b55 tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-563b95e0-0403-4de8-b7af-b84284d08b55 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-563b95e0-0403-4de8-b7af-b84284d08b55 tempest-CreateVolumesFromSnapshotTest-542375037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-563b95e0-0403-4de8-b7af-b84284d08b55 tempest-CreateVolumesFromSnapshotTest-542375037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-563b95e0-0403-4de8-b7af-b84284d08b55 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-563b95e0-0403-4de8-b7af-b84284d08b55 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:21 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:51:21 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2c39e520-5451-4633-973e-8021ccf6ca69 tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "cinder-7116fd84-464e-46d4-828d-654e18546886-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2c39e520-5451-4633-973e-8021ccf6ca69 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "cinder-7116fd84-464e-46d4-828d-654e18546886-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2c39e520-5451-4633-973e-8021ccf6ca69 tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "cinder-quobyte-7116fd84-464e-46d4-828d-654e18546886" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2c39e520-5451-4633-973e-8021ccf6ca69 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "cinder-quobyte-7116fd84-464e-46d4-828d-654e18546886" acquired by "delete_volume" :: waited 0.030s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b3c80c98-8813-49f2-8286-7a1a094b7bfe tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Acquiring lock "cinder-c98834f3-64d5-4e78-8b85-5de8a530451d-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:21 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb465afd-eeb0-4ea8-baf0-e46b6fd7e688]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2c39e520-5451-4633-973e-8021ccf6ca69 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7116fd84-464e-46d4-828d-654e18546886 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b3c80c98-8813-49f2-8286-7a1a094b7bfe tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "cinder-c98834f3-64d5-4e78-8b85-5de8a530451d-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:21 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b3c80c98-8813-49f2-8286-7a1a094b7bfe tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Acquiring lock "cinder-quobyte-c98834f3-64d5-4e78-8b85-5de8a530451d" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-563b95e0-0403-4de8-b7af-b84284d08b55 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.425s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:21 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-563b95e0-0403-4de8-b7af-b84284d08b55 tempest-CreateVolumesFromSnapshotTest-542375037 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:51:21 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-563b95e0-0403-4de8-b7af-b84284d08b55 tempest-CreateVolumesFromSnapshotTest-542375037 None] Deleted volume successfully. Sep 05 11:51:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b3c80c98-8813-49f2-8286-7a1a094b7bfe tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "cinder-quobyte-c98834f3-64d5-4e78-8b85-5de8a530451d" acquired by "delete_volume" :: waited 0.029s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:21 devstack sudo[105248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7116fd84-464e-46d4-828d-654e18546886 Sep 05 11:51:21 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:21 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bf92de-321b-4687-9f16-6f18cf7ae004]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b3c80c98-8813-49f2-8286-7a1a094b7bfe tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c98834f3-64d5-4e78-8b85-5de8a530451d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-563b95e0-0403-4de8-b7af-b84284d08b55 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "cinder-72b2b7dd-1ee6-4bf8-8767-fbc9f92dd484-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:22 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c98834f3-64d5-4e78-8b85-5de8a530451d Sep 05 11:51:22 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:22 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2c39e520-5451-4633-973e-8021ccf6ca69 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7116fd84-464e-46d4-828d-654e18546886" returned: 0 in 0.513s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2c39e520-5451-4633-973e-8021ccf6ca69 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7116fd84-464e-46d4-828d-654e18546886 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:22 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7116fd84-464e-46d4-828d-654e18546886 Sep 05 11:51:22 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:22 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b3c80c98-8813-49f2-8286-7a1a094b7bfe tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c98834f3-64d5-4e78-8b85-5de8a530451d" returned: 0 in 0.479s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b3c80c98-8813-49f2-8286-7a1a094b7bfe tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c98834f3-64d5-4e78-8b85-5de8a530451d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:22 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c98834f3-64d5-4e78-8b85-5de8a530451d Sep 05 11:51:22 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:22 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2c39e520-5451-4633-973e-8021ccf6ca69 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7116fd84-464e-46d4-828d-654e18546886" returned: 0 in 0.325s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2c39e520-5451-4633-973e-8021ccf6ca69 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "cinder-quobyte-7116fd84-464e-46d4-828d-654e18546886" released by "delete_volume" :: held 0.920s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:22 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-2c39e520-5451-4633-973e-8021ccf6ca69 tempest-CreateVolumesFromSnapshotTest-542375037 None] Created reservations ['e7581ad7-8a85-44b5-949a-28557174b778', 'f18f8548-b169-42c1-8b29-adf433ba9548', '5b3eb04a-48e7-425a-a922-fe57450be3d5', '824c9435-504b-4d5c-8209-4005e9ffbcdb'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:51:22 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2c39e520-5451-4633-973e-8021ccf6ca69 tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2c39e520-5451-4633-973e-8021ccf6ca69 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2c39e520-5451-4633-973e-8021ccf6ca69 tempest-CreateVolumesFromSnapshotTest-542375037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2c39e520-5451-4633-973e-8021ccf6ca69 tempest-CreateVolumesFromSnapshotTest-542375037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2c39e520-5451-4633-973e-8021ccf6ca69 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2c39e520-5451-4633-973e-8021ccf6ca69 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b3c80c98-8813-49f2-8286-7a1a094b7bfe tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c98834f3-64d5-4e78-8b85-5de8a530451d" returned: 0 in 0.362s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:22 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:51:22 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b3c80c98-8813-49f2-8286-7a1a094b7bfe tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "cinder-quobyte-c98834f3-64d5-4e78-8b85-5de8a530451d" released by "delete_volume" :: held 0.910s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:22 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-b3c80c98-8813-49f2-8286-7a1a094b7bfe tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Created reservations ['e3dc7d24-9419-48ab-a814-f1a9539fb5c2', '654dc0b7-0755-4202-b266-785b177390e2', '3f9b5aac-cc57-4429-a7d8-f9a4f09e6805', '1b95d397-e214-48b2-83d0-999275a52271'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:51:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b3c80c98-8813-49f2-8286-7a1a094b7bfe tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b3c80c98-8813-49f2-8286-7a1a094b7bfe tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b3c80c98-8813-49f2-8286-7a1a094b7bfe tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b3c80c98-8813-49f2-8286-7a1a094b7bfe tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b3c80c98-8813-49f2-8286-7a1a094b7bfe tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b3c80c98-8813-49f2-8286-7a1a094b7bfe tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:22 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:51:22 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:23 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2c39e520-5451-4633-973e-8021ccf6ca69 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.357s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:23 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-2c39e520-5451-4633-973e-8021ccf6ca69 tempest-CreateVolumesFromSnapshotTest-542375037 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:51:23 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2c39e520-5451-4633-973e-8021ccf6ca69 tempest-CreateVolumesFromSnapshotTest-542375037 None] Deleted volume successfully. Sep 05 11:51:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2c39e520-5451-4633-973e-8021ccf6ca69 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "cinder-7116fd84-464e-46d4-828d-654e18546886-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:23 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b3c80c98-8813-49f2-8286-7a1a094b7bfe tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.292s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:23 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-b3c80c98-8813-49f2-8286-7a1a094b7bfe tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:51:23 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b3c80c98-8813-49f2-8286-7a1a094b7bfe tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Deleted volume successfully. Sep 05 11:51:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b3c80c98-8813-49f2-8286-7a1a094b7bfe tempest-CreateVolumesFromSourceVolumeTest-1866433450 None] Lock "cinder-c98834f3-64d5-4e78-8b85-5de8a530451d-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5b292afe-ced5-4787-9bd3-e0230d53be50 tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "cinder-eb70f019-4371-422b-b637-e252dc78737e-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5b292afe-ced5-4787-9bd3-e0230d53be50 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "cinder-eb70f019-4371-422b-b637-e252dc78737e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5b292afe-ced5-4787-9bd3-e0230d53be50 tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "cinder-quobyte-eb70f019-4371-422b-b637-e252dc78737e" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5b292afe-ced5-4787-9bd3-e0230d53be50 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "cinder-quobyte-eb70f019-4371-422b-b637-e252dc78737e" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:24 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0db797-84c0-4204-b4db-8882ecd6005e]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5b292afe-ced5-4787-9bd3-e0230d53be50 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eb70f019-4371-422b-b637-e252dc78737e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:24 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eb70f019-4371-422b-b637-e252dc78737e Sep 05 11:51:24 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:24 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:51:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] Flow 'volume_create_manager' (be2c42ce-6f85-4bb5-bf90-5b85d85400d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e06cb05e-48b2-44cc-999f-1524f27c51b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e06cb05e-48b2-44cc-999f-1524f27c51b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1299605640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c1e7d69-6b90-4bbc-be88-f0ac2b171f24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50161c703a6d46bb9f7f350860cc021a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:24Z,use_quota=True,user_id='cf4e006bc3614eda96cb38523035ff4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec016db-5574-466c-8612-4f0985437e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec016db-5574-466c-8612-4f0985437e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a01fb0-bb3d-466d-b3c9-3115ef04056d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a01fb0-bb3d-466d-b3c9-3115ef04056d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c1e7d69-6b90-4bbc-be88-f0ac2b171f24', 'volume_name': 'volume-0c1e7d69-6b90-4bbc-be88-f0ac2b171f24', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6239f9b6-5b18-45fd-a1a5-b1dbb0969af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6239f9b6-5b18-45fd-a1a5-b1dbb0969af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:24 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29102ed8-4785-4e44-a571-4bac8a0d5eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:24 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] Volume 0c1e7d69-6b90-4bbc-be88-f0ac2b171f24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c1e7d69-6b90-4bbc-be88-f0ac2b171f24', 'volume_size': 1} Sep 05 11:51:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1299605640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c1e7d69-6b90-4bbc-be88-f0ac2b171f24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50161c703a6d46bb9f7f350860cc021a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:24Z,use_quota=True,user_id='cf4e006bc3614eda96cb38523035ff4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:51:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] Creating volume 0c1e7d69-6b90-4bbc-be88-f0ac2b171f24 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:51:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:51:24 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:51:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0c1e7d69-6b90-4bbc-be88-f0ac2b171f24 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:24 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5b292afe-ced5-4787-9bd3-e0230d53be50 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eb70f019-4371-422b-b637-e252dc78737e" returned: 0 in 0.518s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5b292afe-ced5-4787-9bd3-e0230d53be50 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eb70f019-4371-422b-b637-e252dc78737e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:24 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0c1e7d69-6b90-4bbc-be88-f0ac2b171f24 1073741824 Sep 05 11:51:24 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:24 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eb70f019-4371-422b-b637-e252dc78737e Sep 05 11:51:24 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] Flow 'volume_create_manager' (67e33202-f771-47c1-aabe-d44b6111e35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512e8e2b-0a84-4159-be51-ce53d04c4995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:25 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512e8e2b-0a84-4159-be51-ce53d04c4995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-167590061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65b4c713-9d4e-4485-8320-0f2e3e3f5c60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50161c703a6d46bb9f7f350860cc021a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:25Z,use_quota=True,user_id='cf4e006bc3614eda96cb38523035ff4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15247022-65fe-4002-8a30-8dd5913e4103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15247022-65fe-4002-8a30-8dd5913e4103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbff82b6-63ff-418e-8b87-ee7794f0b334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbff82b6-63ff-418e-8b87-ee7794f0b334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65b4c713-9d4e-4485-8320-0f2e3e3f5c60', 'volume_name': 'volume-65b4c713-9d4e-4485-8320-0f2e3e3f5c60', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (791a139f-c126-4448-9446-60aafbc1ba77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (791a139f-c126-4448-9446-60aafbc1ba77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d59625b-3628-46e4-af8d-efd535bbaf08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:25 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] Volume 65b4c713-9d4e-4485-8320-0f2e3e3f5c60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65b4c713-9d4e-4485-8320-0f2e3e3f5c60', 'volume_size': 1} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5b292afe-ced5-4787-9bd3-e0230d53be50 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-eb70f019-4371-422b-b637-e252dc78737e" returned: 0 in 0.604s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5b292afe-ced5-4787-9bd3-e0230d53be50 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "cinder-quobyte-eb70f019-4371-422b-b637-e252dc78737e" released by "delete_volume" :: held 1.190s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:25 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0c1e7d69-6b90-4bbc-be88-f0ac2b171f24 1073741824" returned: 0 in 0.721s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-5b292afe-ced5-4787-9bd3-e0230d53be50 tempest-CreateVolumesFromSnapshotTest-542375037 None] Created reservations ['1fda39d6-f847-4a38-87b9-880190ba130b', '572d402a-be2f-457e-bb82-f17f2da8728e', '67eec1f8-43d4-4f07-84ae-f5fa0d6821de', '8704c7c1-1c7c-4c29-8d72-1cb9856976aa'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0c1e7d69-6b90-4bbc-be88-f0ac2b171f24 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:25 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0c1e7d69-6b90-4bbc-be88-f0ac2b171f24 Sep 05 11:51:25 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5b292afe-ced5-4787-9bd3-e0230d53be50 tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5b292afe-ced5-4787-9bd3-e0230d53be50 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5b292afe-ced5-4787-9bd3-e0230d53be50 tempest-CreateVolumesFromSnapshotTest-542375037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5b292afe-ced5-4787-9bd3-e0230d53be50 tempest-CreateVolumesFromSnapshotTest-542375037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5b292afe-ced5-4787-9bd3-e0230d53be50 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5b292afe-ced5-4787-9bd3-e0230d53be50 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:25 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:51:25 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:25 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0c1e7d69-6b90-4bbc-be88-f0ac2b171f24" returned: 0 in 0.350s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.493s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-167590061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65b4c713-9d4e-4485-8320-0f2e3e3f5c60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50161c703a6d46bb9f7f350860cc021a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:25Z,use_quota=True,user_id='cf4e006bc3614eda96cb38523035ff4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] Creating volume 65b4c713-9d4e-4485-8320-0f2e3e3f5c60 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:51:25 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-65b4c713-9d4e-4485-8320-0f2e3e3f5c60 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29102ed8-4785-4e44-a571-4bac8a0d5eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c1e7d69-6b90-4bbc-be88-f0ac2b171f24', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:25 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-65b4c713-9d4e-4485-8320-0f2e3e3f5c60 1073741824 Sep 05 11:51:25 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eeeee41-b76d-46a7-8ea6-85d30bd31349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] Flow 'volume_create_manager' (fead0bb4-274d-4825-b2d3-a220f7af278e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7088a255-8465-4cca-b7f7-bacef200202d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:25 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] Volume volume-0c1e7d69-6b90-4bbc-be88-f0ac2b171f24 (0c1e7d69-6b90-4bbc-be88-f0ac2b171f24): created successfully Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eeeee41-b76d-46a7-8ea6-85d30bd31349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] Flow 'volume_create_manager' (be2c42ce-6f85-4bb5-bf90-5b85d85400d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7088a255-8465-4cca-b7f7-bacef200202d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-112987309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef2d7a22-d33d-4c5b-bb55-b2dc2a227765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50161c703a6d46bb9f7f350860cc021a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:26Z,use_quota=True,user_id='cf4e006bc3614eda96cb38523035ff4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f8e826-41ac-4e6e-8dc9-293b7f1ae624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f8e826-41ac-4e6e-8dc9-293b7f1ae624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58da3384-bab4-41dd-90b9-0b2a961427a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58da3384-bab4-41dd-90b9-0b2a961427a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef2d7a22-d33d-4c5b-bb55-b2dc2a227765', 'volume_name': 'volume-ef2d7a22-d33d-4c5b-bb55-b2dc2a227765', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a55ea5-62b6-4953-bb2e-8111a0975f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a55ea5-62b6-4953-bb2e-8111a0975f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b37faf82-7743-43e0-9dce-a84eb39e5652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:26 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] Volume ef2d7a22-d33d-4c5b-bb55-b2dc2a227765: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef2d7a22-d33d-4c5b-bb55-b2dc2a227765', 'volume_size': 1} Sep 05 11:51:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:26 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-798687ed-785d-48c7-b099-c77886d02f4c tempest-CreateVolumesFromImageTest-2005442537 None] Created volume successfully. Sep 05 11:51:26 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5b292afe-ced5-4787-9bd3-e0230d53be50 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.622s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:26 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-5b292afe-ced5-4787-9bd3-e0230d53be50 tempest-CreateVolumesFromSnapshotTest-542375037 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:51:26 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-5b292afe-ced5-4787-9bd3-e0230d53be50 tempest-CreateVolumesFromSnapshotTest-542375037 None] Deleted volume successfully. Sep 05 11:51:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5b292afe-ced5-4787-9bd3-e0230d53be50 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "cinder-eb70f019-4371-422b-b637-e252dc78737e-delete_volume" released by "delete_volume" :: held 2.138s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] Flow 'volume_create_manager' (5b898f91-363f-4032-9f64-4ff4edf86ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a265f75a-29a9-4a67-9bc3-7cb191e203f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9c747012-2465-4b9a-af02-3bda303cc7a1 tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "cinder-20af6ddd-2df3-477f-8fec-52827627778a-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a265f75a-29a9-4a67-9bc3-7cb191e203f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-254021159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ded3ca-16a2-4576-bef0-580d9fc6d2d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50161c703a6d46bb9f7f350860cc021a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:26Z,use_quota=True,user_id='cf4e006bc3614eda96cb38523035ff4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00199fc2-7206-47f4-ba56-44d93f63e0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:26 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00199fc2-7206-47f4-ba56-44d93f63e0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e520910-3661-42ad-8a9f-abfd27f9c02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e520910-3661-42ad-8a9f-abfd27f9c02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48ded3ca-16a2-4576-bef0-580d9fc6d2d6', 'volume_name': 'volume-48ded3ca-16a2-4576-bef0-580d9fc6d2d6', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3c66cd2-1eb3-49fd-91ac-46104f9eb9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3c66cd2-1eb3-49fd-91ac-46104f9eb9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69b7651f-b364-4d99-881d-03752921d6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:26 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] Volume 48ded3ca-16a2-4576-bef0-580d9fc6d2d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48ded3ca-16a2-4576-bef0-580d9fc6d2d6', 'volume_size': 1} Sep 05 11:51:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-65b4c713-9d4e-4485-8320-0f2e3e3f5c60 1073741824" returned: 0 in 0.860s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9c747012-2465-4b9a-af02-3bda303cc7a1 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "cinder-20af6ddd-2df3-477f-8fec-52827627778a-delete_volume" acquired by "delete_volume" :: waited 0.129s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-65b4c713-9d4e-4485-8320-0f2e3e3f5c60 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9c747012-2465-4b9a-af02-3bda303cc7a1 tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "cinder-quobyte-20af6ddd-2df3-477f-8fec-52827627778a" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:26 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9c747012-2465-4b9a-af02-3bda303cc7a1 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "cinder-quobyte-20af6ddd-2df3-477f-8fec-52827627778a" acquired by "delete_volume" :: waited 0.035s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:26 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-65b4c713-9d4e-4485-8320-0f2e3e3f5c60 Sep 05 11:51:26 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:26 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a0a008-59e9-43ad-84f6-12814d08b343]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9c747012-2465-4b9a-af02-3bda303cc7a1 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20af6ddd-2df3-477f-8fec-52827627778a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] Flow 'volume_create_manager' (2d97bb21-dcbf-40b1-9cf1-b2201d2f122f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3755a6-c4ac-4dfa-8f03-2f436885226d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:27 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20af6ddd-2df3-477f-8fec-52827627778a Sep 05 11:51:27 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3755a6-c4ac-4dfa-8f03-2f436885226d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-541908786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf64486-d182-4192-b050-78c6aaba2ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50161c703a6d46bb9f7f350860cc021a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:27Z,use_quota=True,user_id='cf4e006bc3614eda96cb38523035ff4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7766403-98aa-4d4f-a59f-1460c551d3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7766403-98aa-4d4f-a59f-1460c551d3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f82dcdb2-5a34-413e-9b7f-59bba93b1a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f82dcdb2-5a34-413e-9b7f-59bba93b1a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abf64486-d182-4192-b050-78c6aaba2ee0', 'volume_name': 'volume-abf64486-d182-4192-b050-78c6aaba2ee0', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c9df6a6-a927-48cb-a600-1e2cfd1e43ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:27 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c9df6a6-a927-48cb-a600-1e2cfd1e43ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32183b82-2da5-4ff0-9ed1-8ff68cfb5c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:27 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] Volume abf64486-d182-4192-b050-78c6aaba2ee0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abf64486-d182-4192-b050-78c6aaba2ee0', 'volume_size': 1} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-65b4c713-9d4e-4485-8320-0f2e3e3f5c60" returned: 0 in 0.492s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.170s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-112987309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef2d7a22-d33d-4c5b-bb55-b2dc2a227765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50161c703a6d46bb9f7f350860cc021a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:26Z,use_quota=True,user_id='cf4e006bc3614eda96cb38523035ff4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] Creating volume ef2d7a22-d33d-4c5b-bb55-b2dc2a227765 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:51:27 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ef2d7a22-d33d-4c5b-bb55-b2dc2a227765 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d59625b-3628-46e4-af8d-efd535bbaf08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65b4c713-9d4e-4485-8320-0f2e3e3f5c60', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:27 devstack sudo[105309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ef2d7a22-d33d-4c5b-bb55-b2dc2a227765 1073741824 Sep 05 11:51:27 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8b86a52-3108-446c-8896-0a63006ad45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:27 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] Volume volume-65b4c713-9d4e-4485-8320-0f2e3e3f5c60 (65b4c713-9d4e-4485-8320-0f2e3e3f5c60): created successfully Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8b86a52-3108-446c-8896-0a63006ad45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] Flow 'volume_create_manager' (67e33202-f771-47c1-aabe-d44b6111e35b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:27 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b8174684-f85d-4fa6-802f-7b01fcccb3e0 tempest-CreateVolumesFromImageTest-2005442537 None] Created volume successfully. Sep 05 11:51:27 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9c747012-2465-4b9a-af02-3bda303cc7a1 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20af6ddd-2df3-477f-8fec-52827627778a" returned: 0 in 0.645s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9c747012-2465-4b9a-af02-3bda303cc7a1 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20af6ddd-2df3-477f-8fec-52827627778a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:27 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20af6ddd-2df3-477f-8fec-52827627778a Sep 05 11:51:27 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:27 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9c747012-2465-4b9a-af02-3bda303cc7a1 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20af6ddd-2df3-477f-8fec-52827627778a" returned: 0 in 0.315s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9c747012-2465-4b9a-af02-3bda303cc7a1 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "cinder-quobyte-20af6ddd-2df3-477f-8fec-52827627778a" released by "delete_volume" :: held 1.031s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:27 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ef2d7a22-d33d-4c5b-bb55-b2dc2a227765 1073741824" returned: 0 in 0.635s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-9c747012-2465-4b9a-af02-3bda303cc7a1 tempest-CreateVolumesFromSnapshotTest-542375037 None] Created reservations ['d3d34cf3-5d9f-4db5-9c91-937fc3e5c750', 'e4d48093-f991-48e2-9f2c-9ab953f94d77', '0e3c0d94-fa1b-45ae-889a-62b05a95e7c1', 'e459c043-6725-496e-ac64-20334764bcff'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ef2d7a22-d33d-4c5b-bb55-b2dc2a227765 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:27 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ef2d7a22-d33d-4c5b-bb55-b2dc2a227765 Sep 05 11:51:27 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9c747012-2465-4b9a-af02-3bda303cc7a1 tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9c747012-2465-4b9a-af02-3bda303cc7a1 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9c747012-2465-4b9a-af02-3bda303cc7a1 tempest-CreateVolumesFromSnapshotTest-542375037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9c747012-2465-4b9a-af02-3bda303cc7a1 tempest-CreateVolumesFromSnapshotTest-542375037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9c747012-2465-4b9a-af02-3bda303cc7a1 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9c747012-2465-4b9a-af02-3bda303cc7a1 tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:28 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:51:28 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:28 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ef2d7a22-d33d-4c5b-bb55-b2dc2a227765" returned: 0 in 0.355s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.652s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-254021159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ded3ca-16a2-4576-bef0-580d9fc6d2d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50161c703a6d46bb9f7f350860cc021a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:26Z,use_quota=True,user_id='cf4e006bc3614eda96cb38523035ff4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] Creating volume 48ded3ca-16a2-4576-bef0-580d9fc6d2d6 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:51:28 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-48ded3ca-16a2-4576-bef0-580d9fc6d2d6 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:28 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-48ded3ca-16a2-4576-bef0-580d9fc6d2d6 1073741824 Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b37faf82-7743-43e0-9dce-a84eb39e5652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef2d7a22-d33d-4c5b-bb55-b2dc2a227765', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:28 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa5d9e7-ba9f-4107-9be1-45473e489f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:28 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] Volume volume-ef2d7a22-d33d-4c5b-bb55-b2dc2a227765 (ef2d7a22-d33d-4c5b-bb55-b2dc2a227765): created successfully Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa5d9e7-ba9f-4107-9be1-45473e489f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] Flow 'volume_create_manager' (fead0bb4-274d-4825-b2d3-a220f7af278e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:28 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9c747012-2465-4b9a-af02-3bda303cc7a1 tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.423s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-9c747012-2465-4b9a-af02-3bda303cc7a1 tempest-CreateVolumesFromSnapshotTest-542375037 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:51:28 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7bc08971-242e-4886-ba62-c5c8cc629263 tempest-CreateVolumesFromImageTest-2005442537 None] Created volume successfully. Sep 05 11:51:28 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-9c747012-2465-4b9a-af02-3bda303cc7a1 tempest-CreateVolumesFromSnapshotTest-542375037 None] Deleted volume successfully. Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9c747012-2465-4b9a-af02-3bda303cc7a1 tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "cinder-20af6ddd-2df3-477f-8fec-52827627778a-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-ee4f9831-d653-4237-92bb-48c8b9b4131c tempest-ProjectAdminTests-358885053 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6866188049316, 'free_capacity_gb': 1773.6866188049316, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87517) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-02858a21-7be6-44bf-880d-ce01db12276e tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "cinder-a07d7f4f-1994-44af-b2cb-9e5f6bea234e-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-02858a21-7be6-44bf-880d-ce01db12276e tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "cinder-a07d7f4f-1994-44af-b2cb-9e5f6bea234e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-02858a21-7be6-44bf-880d-ce01db12276e tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "cinder-quobyte-22b0824b-e727-4a1c-8a5c-dfa5d267033d" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-02858a21-7be6-44bf-880d-ce01db12276e tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "cinder-quobyte-22b0824b-e727-4a1c-8a5c-dfa5d267033d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-02858a21-7be6-44bf-880d-ce01db12276e tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "cinder-quobyte-a07d7f4f-1994-44af-b2cb-9e5f6bea234e" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-02858a21-7be6-44bf-880d-ce01db12276e tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "cinder-quobyte-a07d7f4f-1994-44af-b2cb-9e5f6bea234e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-02858a21-7be6-44bf-880d-ce01db12276e tempest-CreateVolumesFromSnapshotTest-542375037 None] Deleting offline snapshot a07d7f4f-1994-44af-b2cb-9e5f6bea234e of volume 22b0824b-e727-4a1c-8a5c-dfa5d267033d {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-02858a21-7be6-44bf-880d-ce01db12276e tempest-CreateVolumesFromSnapshotTest-542375037 None] snapshot_file for this snap is: volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d.a07d7f4f-1994-44af-b2cb-9e5f6bea234e {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:51:28 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-48ded3ca-16a2-4576-bef0-580d9fc6d2d6 1073741824" returned: 0 in 0.652s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f46522-3ad6-4995-ac34-7923292ec436]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-02858a21-7be6-44bf-880d-ce01db12276e tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d.a07d7f4f-1994-44af-b2cb-9e5f6bea234e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-48ded3ca-16a2-4576-bef0-580d9fc6d2d6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:28 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-48ded3ca-16a2-4576-bef0-580d9fc6d2d6 Sep 05 11:51:29 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:29 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d.a07d7f4f-1994-44af-b2cb-9e5f6bea234e Sep 05 11:51:29 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:29 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-48ded3ca-16a2-4576-bef0-580d9fc6d2d6" returned: 0 in 0.301s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:51:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.117s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-541908786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf64486-d182-4192-b050-78c6aaba2ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50161c703a6d46bb9f7f350860cc021a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:27Z,use_quota=True,user_id='cf4e006bc3614eda96cb38523035ff4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:51:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] Creating volume abf64486-d182-4192-b050-78c6aaba2ee0 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:51:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:51:29 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:51:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-abf64486-d182-4192-b050-78c6aaba2ee0 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69b7651f-b364-4d99-881d-03752921d6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48ded3ca-16a2-4576-bef0-580d9fc6d2d6', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:29 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-abf64486-d182-4192-b050-78c6aaba2ee0 1073741824 Sep 05 11:51:29 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f58c648-7e44-4bfa-b9f7-c1986b60e285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:29 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] Volume volume-48ded3ca-16a2-4576-bef0-580d9fc6d2d6 (48ded3ca-16a2-4576-bef0-580d9fc6d2d6): created successfully Sep 05 11:51:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f58c648-7e44-4bfa-b9f7-c1986b60e285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:29 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] Flow 'volume_create_manager' (5b898f91-363f-4032-9f64-4ff4edf86ae1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:29 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-02858a21-7be6-44bf-880d-ce01db12276e tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d.a07d7f4f-1994-44af-b2cb-9e5f6bea234e" returned: 0 in 0.475s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-02858a21-7be6-44bf-880d-ce01db12276e tempest-CreateVolumesFromSnapshotTest-542375037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:51:29 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a32c7316-6ff6-4884-9181-63ffb2817c01 tempest-CreateVolumesFromImageTest-2005442537 None] Created volume successfully. Sep 05 11:51:29 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[395f6c22-cc7e-4720-a93c-9d04490fc67e]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-02858a21-7be6-44bf-880d-ce01db12276e tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:29 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d Sep 05 11:51:29 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:29 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-abf64486-d182-4192-b050-78c6aaba2ee0 1073741824" returned: 0 in 0.673s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:29 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-02858a21-7be6-44bf-880d-ce01db12276e tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d" returned: 0 in 0.547s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-02858a21-7be6-44bf-880d-ce01db12276e tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d.a07d7f4f-1994-44af-b2cb-9e5f6bea234e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:30 devstack sudo[105352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d.a07d7f4f-1994-44af-b2cb-9e5f6bea234e Sep 05 11:51:30 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-abf64486-d182-4192-b050-78c6aaba2ee0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:30 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-abf64486-d182-4192-b050-78c6aaba2ee0 Sep 05 11:51:30 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:30 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-abf64486-d182-4192-b050-78c6aaba2ee0" returned: 0 in 0.285s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:30 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:51:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32183b82-2da5-4ff0-9ed1-8ff68cfb5c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abf64486-d182-4192-b050-78c6aaba2ee0', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c00233f0-a021-4639-9461-ad50dc9db0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:30 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] Volume volume-abf64486-d182-4192-b050-78c6aaba2ee0 (abf64486-d182-4192-b050-78c6aaba2ee0): created successfully Sep 05 11:51:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c00233f0-a021-4639-9461-ad50dc9db0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:30 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] Flow 'volume_create_manager' (2d97bb21-dcbf-40b1-9cf1-b2201d2f122f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:30 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-02858a21-7be6-44bf-880d-ce01db12276e tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d.a07d7f4f-1994-44af-b2cb-9e5f6bea234e" returned: 0 in 0.399s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-02858a21-7be6-44bf-880d-ce01db12276e tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d.a07d7f4f-1994-44af-b2cb-9e5f6bea234e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:30 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-8a0bed38-5664-482d-89bd-93afe7b0eacf tempest-CreateVolumesFromImageTest-2005442537 None] Created volume successfully. Sep 05 11:51:30 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d.a07d7f4f-1994-44af-b2cb-9e5f6bea234e Sep 05 11:51:30 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a1aa3060-5bca-4cbc-af15-31f1a3078b74 tempest-CreateVolumesFromImageTest-2005442537 None] Acquiring lock "cinder-abf64486-d182-4192-b050-78c6aaba2ee0-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:30 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-02858a21-7be6-44bf-880d-ce01db12276e tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d.a07d7f4f-1994-44af-b2cb-9e5f6bea234e" returned: 0 in 0.323s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a1aa3060-5bca-4cbc-af15-31f1a3078b74 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "cinder-abf64486-d182-4192-b050-78c6aaba2ee0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-02858a21-7be6-44bf-880d-ce01db12276e tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "cinder-quobyte-a07d7f4f-1994-44af-b2cb-9e5f6bea234e" released by "_delete_snapshot" :: held 1.911s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-02858a21-7be6-44bf-880d-ce01db12276e tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "cinder-quobyte-22b0824b-e727-4a1c-8a5c-dfa5d267033d" released by "delete_snapshot" :: held 1.944s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a1aa3060-5bca-4cbc-af15-31f1a3078b74 tempest-CreateVolumesFromImageTest-2005442537 None] Acquiring lock "cinder-quobyte-abf64486-d182-4192-b050-78c6aaba2ee0" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a1aa3060-5bca-4cbc-af15-31f1a3078b74 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "cinder-quobyte-abf64486-d182-4192-b050-78c6aaba2ee0" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:30 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b88fdaa-3de8-4f98-a5b5-e7aa2646bb96]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a1aa3060-5bca-4cbc-af15-31f1a3078b74 tempest-CreateVolumesFromImageTest-2005442537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-abf64486-d182-4192-b050-78c6aaba2ee0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:30 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-02858a21-7be6-44bf-880d-ce01db12276e tempest-CreateVolumesFromSnapshotTest-542375037 None] Created reservations ['55ce111b-58b5-459b-b888-b1e9420b960d', '3bc772c4-b011-4bbf-a9ed-95e57e8b8360', '1e04dc1a-f1da-4941-a895-97edf53f9cf7', '6fd966d0-c2b8-447b-829a-f02204fd9b2b'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:51:31 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-02858a21-7be6-44bf-880d-ce01db12276e tempest-CreateVolumesFromSnapshotTest-542375037 None] Delete snapshot completed successfully. Sep 05 11:51:31 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-abf64486-d182-4192-b050-78c6aaba2ee0 Sep 05 11:51:31 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-02858a21-7be6-44bf-880d-ce01db12276e tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "cinder-a07d7f4f-1994-44af-b2cb-9e5f6bea234e-delete_snapshot" released by "delete_snapshot" :: held 2.176s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c02a64d1-411b-45c0-9c67-691bb20e323c tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "cinder-22b0824b-e727-4a1c-8a5c-dfa5d267033d-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c02a64d1-411b-45c0-9c67-691bb20e323c tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "cinder-22b0824b-e727-4a1c-8a5c-dfa5d267033d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c02a64d1-411b-45c0-9c67-691bb20e323c tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "cinder-quobyte-22b0824b-e727-4a1c-8a5c-dfa5d267033d" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c02a64d1-411b-45c0-9c67-691bb20e323c tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "cinder-quobyte-22b0824b-e727-4a1c-8a5c-dfa5d267033d" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:31 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[90048374-4579-4f10-9014-e554d0f0ef1c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c02a64d1-411b-45c0-9c67-691bb20e323c tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:31 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a1aa3060-5bca-4cbc-af15-31f1a3078b74 tempest-CreateVolumesFromImageTest-2005442537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-abf64486-d182-4192-b050-78c6aaba2ee0" returned: 0 in 0.484s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a1aa3060-5bca-4cbc-af15-31f1a3078b74 tempest-CreateVolumesFromImageTest-2005442537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-abf64486-d182-4192-b050-78c6aaba2ee0 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:31 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-abf64486-d182-4192-b050-78c6aaba2ee0 Sep 05 11:51:31 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:31 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d Sep 05 11:51:31 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:31 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a1aa3060-5bca-4cbc-af15-31f1a3078b74 tempest-CreateVolumesFromImageTest-2005442537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-abf64486-d182-4192-b050-78c6aaba2ee0" returned: 0 in 0.302s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a1aa3060-5bca-4cbc-af15-31f1a3078b74 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "cinder-quobyte-abf64486-d182-4192-b050-78c6aaba2ee0" released by "delete_volume" :: held 0.849s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:31 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c02a64d1-411b-45c0-9c67-691bb20e323c tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d" returned: 0 in 0.450s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c02a64d1-411b-45c0-9c67-691bb20e323c tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:31 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d Sep 05 11:51:31 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:31 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-a1aa3060-5bca-4cbc-af15-31f1a3078b74 tempest-CreateVolumesFromImageTest-2005442537 None] Created reservations ['9faaf1e2-513a-4a03-a895-3fd6362a3bb9', '57ae623c-5a9c-4a17-af3e-e239d81bb2da', '4652731f-869b-47d3-8e24-dc8d3bf1374a', '7b8bc2a4-dd45-48bd-b3df-e53d958d4c88'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:51:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a1aa3060-5bca-4cbc-af15-31f1a3078b74 tempest-CreateVolumesFromImageTest-2005442537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a1aa3060-5bca-4cbc-af15-31f1a3078b74 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a1aa3060-5bca-4cbc-af15-31f1a3078b74 tempest-CreateVolumesFromImageTest-2005442537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a1aa3060-5bca-4cbc-af15-31f1a3078b74 tempest-CreateVolumesFromImageTest-2005442537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a1aa3060-5bca-4cbc-af15-31f1a3078b74 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a1aa3060-5bca-4cbc-af15-31f1a3078b74 tempest-CreateVolumesFromImageTest-2005442537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:31 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:51:31 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-96fd1074-f0de-44a4-ba8e-27f049901847 tempest-CreateVolumesFromImageTest-2005442537 None] Acquiring lock "cinder-48ded3ca-16a2-4576-bef0-580d9fc6d2d6-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-96fd1074-f0de-44a4-ba8e-27f049901847 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "cinder-48ded3ca-16a2-4576-bef0-580d9fc6d2d6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:32 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c02a64d1-411b-45c0-9c67-691bb20e323c tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-22b0824b-e727-4a1c-8a5c-dfa5d267033d" returned: 0 in 0.342s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-96fd1074-f0de-44a4-ba8e-27f049901847 tempest-CreateVolumesFromImageTest-2005442537 None] Acquiring lock "cinder-quobyte-48ded3ca-16a2-4576-bef0-580d9fc6d2d6" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c02a64d1-411b-45c0-9c67-691bb20e323c tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "cinder-quobyte-22b0824b-e727-4a1c-8a5c-dfa5d267033d" released by "delete_volume" :: held 0.868s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-96fd1074-f0de-44a4-ba8e-27f049901847 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "cinder-quobyte-48ded3ca-16a2-4576-bef0-580d9fc6d2d6" acquired by "delete_volume" :: waited 0.043s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d726a31f-4c51-4554-859f-3a45338c37a0]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-96fd1074-f0de-44a4-ba8e-27f049901847 tempest-CreateVolumesFromImageTest-2005442537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-48ded3ca-16a2-4576-bef0-580d9fc6d2d6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-c02a64d1-411b-45c0-9c67-691bb20e323c tempest-CreateVolumesFromSnapshotTest-542375037 None] Created reservations ['320e0068-3d88-4a64-a9b2-5376dc7c7f31', '9e2255ca-b48a-4356-9247-a690dbdad970', 'b9317667-3b5e-4f8a-bb57-e22b9121783b', '37f3d99c-bf9e-4589-9f25-74ee2274bcc9'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:51:32 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a1aa3060-5bca-4cbc-af15-31f1a3078b74 tempest-CreateVolumesFromImageTest-2005442537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.381s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-a1aa3060-5bca-4cbc-af15-31f1a3078b74 tempest-CreateVolumesFromImageTest-2005442537 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:51:32 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a1aa3060-5bca-4cbc-af15-31f1a3078b74 tempest-CreateVolumesFromImageTest-2005442537 None] Deleted volume successfully. Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a1aa3060-5bca-4cbc-af15-31f1a3078b74 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "cinder-abf64486-d182-4192-b050-78c6aaba2ee0-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:32 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:51:32 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:32 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-48ded3ca-16a2-4576-bef0-580d9fc6d2d6 Sep 05 11:51:32 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c02a64d1-411b-45c0-9c67-691bb20e323c tempest-CreateVolumesFromSnapshotTest-542375037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c02a64d1-411b-45c0-9c67-691bb20e323c tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c02a64d1-411b-45c0-9c67-691bb20e323c tempest-CreateVolumesFromSnapshotTest-542375037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c02a64d1-411b-45c0-9c67-691bb20e323c tempest-CreateVolumesFromSnapshotTest-542375037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c02a64d1-411b-45c0-9c67-691bb20e323c tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c02a64d1-411b-45c0-9c67-691bb20e323c tempest-CreateVolumesFromSnapshotTest-542375037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:32 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:51:32 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:32 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.440s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread count: 28 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread info: [<_MainThread(MainThread, started 131707869511808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 11:51:32 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-96fd1074-f0de-44a4-ba8e-27f049901847 tempest-CreateVolumesFromImageTest-2005442537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-48ded3ca-16a2-4576-bef0-580d9fc6d2d6" returned: 0 in 0.702s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-96fd1074-f0de-44a4-ba8e-27f049901847 tempest-CreateVolumesFromImageTest-2005442537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-48ded3ca-16a2-4576-bef0-580d9fc6d2d6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:32 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-48ded3ca-16a2-4576-bef0-580d9fc6d2d6 Sep 05 11:51:32 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:32 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c02a64d1-411b-45c0-9c67-691bb20e323c tempest-CreateVolumesFromSnapshotTest-542375037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.470s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-c02a64d1-411b-45c0-9c67-691bb20e323c tempest-CreateVolumesFromSnapshotTest-542375037 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:51:32 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c02a64d1-411b-45c0-9c67-691bb20e323c tempest-CreateVolumesFromSnapshotTest-542375037 None] Deleted volume successfully. Sep 05 11:51:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c02a64d1-411b-45c0-9c67-691bb20e323c tempest-CreateVolumesFromSnapshotTest-542375037 None] Lock "cinder-22b0824b-e727-4a1c-8a5c-dfa5d267033d-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:33 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-96fd1074-f0de-44a4-ba8e-27f049901847 tempest-CreateVolumesFromImageTest-2005442537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-48ded3ca-16a2-4576-bef0-580d9fc6d2d6" returned: 0 in 0.364s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:33 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-96fd1074-f0de-44a4-ba8e-27f049901847 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "cinder-quobyte-48ded3ca-16a2-4576-bef0-580d9fc6d2d6" released by "delete_volume" :: held 1.120s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:33 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-96fd1074-f0de-44a4-ba8e-27f049901847 tempest-CreateVolumesFromImageTest-2005442537 None] Created reservations ['22d92fba-d568-4baa-bf55-84537bb759b3', 'dbf65109-2ce6-4b16-90df-641b6c641d8a', '0934da78-2c51-4d1b-8d4f-5c677873abd0', '0bb65e9a-f7d0-4361-898c-e38a6c240168'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:51:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-96fd1074-f0de-44a4-ba8e-27f049901847 tempest-CreateVolumesFromImageTest-2005442537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-96fd1074-f0de-44a4-ba8e-27f049901847 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-96fd1074-f0de-44a4-ba8e-27f049901847 tempest-CreateVolumesFromImageTest-2005442537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-96fd1074-f0de-44a4-ba8e-27f049901847 tempest-CreateVolumesFromImageTest-2005442537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-96fd1074-f0de-44a4-ba8e-27f049901847 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-96fd1074-f0de-44a4-ba8e-27f049901847 tempest-CreateVolumesFromImageTest-2005442537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:33 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:51:33 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:33 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-96fd1074-f0de-44a4-ba8e-27f049901847 tempest-CreateVolumesFromImageTest-2005442537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.290s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:33 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-96fd1074-f0de-44a4-ba8e-27f049901847 tempest-CreateVolumesFromImageTest-2005442537 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:51:33 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-96fd1074-f0de-44a4-ba8e-27f049901847 tempest-CreateVolumesFromImageTest-2005442537 None] Deleted volume successfully. Sep 05 11:51:33 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-96fd1074-f0de-44a4-ba8e-27f049901847 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "cinder-48ded3ca-16a2-4576-bef0-580d9fc6d2d6-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-44165158-18f4-41fc-a2f5-1b0b56abc3f8 tempest-CreateVolumesFromImageTest-2005442537 None] Acquiring lock "cinder-ef2d7a22-d33d-4c5b-bb55-b2dc2a227765-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-44165158-18f4-41fc-a2f5-1b0b56abc3f8 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "cinder-ef2d7a22-d33d-4c5b-bb55-b2dc2a227765-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-44165158-18f4-41fc-a2f5-1b0b56abc3f8 tempest-CreateVolumesFromImageTest-2005442537 None] Acquiring lock "cinder-quobyte-ef2d7a22-d33d-4c5b-bb55-b2dc2a227765" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-44165158-18f4-41fc-a2f5-1b0b56abc3f8 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "cinder-quobyte-ef2d7a22-d33d-4c5b-bb55-b2dc2a227765" acquired by "delete_volume" :: waited 0.030s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:34 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cf94a3-cd72-400f-961b-200567439f0d]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-44165158-18f4-41fc-a2f5-1b0b56abc3f8 tempest-CreateVolumesFromImageTest-2005442537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ef2d7a22-d33d-4c5b-bb55-b2dc2a227765 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:34 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ef2d7a22-d33d-4c5b-bb55-b2dc2a227765 Sep 05 11:51:34 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:34 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-44165158-18f4-41fc-a2f5-1b0b56abc3f8 tempest-CreateVolumesFromImageTest-2005442537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ef2d7a22-d33d-4c5b-bb55-b2dc2a227765" returned: 0 in 0.440s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-44165158-18f4-41fc-a2f5-1b0b56abc3f8 tempest-CreateVolumesFromImageTest-2005442537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ef2d7a22-d33d-4c5b-bb55-b2dc2a227765 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:34 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ef2d7a22-d33d-4c5b-bb55-b2dc2a227765 Sep 05 11:51:34 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:35 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-44165158-18f4-41fc-a2f5-1b0b56abc3f8 tempest-CreateVolumesFromImageTest-2005442537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ef2d7a22-d33d-4c5b-bb55-b2dc2a227765" returned: 0 in 0.305s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-44165158-18f4-41fc-a2f5-1b0b56abc3f8 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "cinder-quobyte-ef2d7a22-d33d-4c5b-bb55-b2dc2a227765" released by "delete_volume" :: held 0.799s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:35 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-44165158-18f4-41fc-a2f5-1b0b56abc3f8 tempest-CreateVolumesFromImageTest-2005442537 None] Created reservations ['ef997a3f-94ff-4780-b10b-a942dc3adcab', '735d99c4-ef66-4fdc-afaf-e0a3448f6648', '424cf943-f914-402c-969b-d5e945aa8463', '3c6fbf56-87f3-4289-94af-4a19c0a2ebcf'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:51:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-44165158-18f4-41fc-a2f5-1b0b56abc3f8 tempest-CreateVolumesFromImageTest-2005442537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-44165158-18f4-41fc-a2f5-1b0b56abc3f8 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-44165158-18f4-41fc-a2f5-1b0b56abc3f8 tempest-CreateVolumesFromImageTest-2005442537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-44165158-18f4-41fc-a2f5-1b0b56abc3f8 tempest-CreateVolumesFromImageTest-2005442537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-44165158-18f4-41fc-a2f5-1b0b56abc3f8 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-44165158-18f4-41fc-a2f5-1b0b56abc3f8 tempest-CreateVolumesFromImageTest-2005442537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:35 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:51:35 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9bc0202c-cfb5-4d8f-a281-67e82e8843a2 tempest-CreateVolumesFromImageTest-2005442537 None] Acquiring lock "cinder-65b4c713-9d4e-4485-8320-0f2e3e3f5c60-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9bc0202c-cfb5-4d8f-a281-67e82e8843a2 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "cinder-65b4c713-9d4e-4485-8320-0f2e3e3f5c60-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9bc0202c-cfb5-4d8f-a281-67e82e8843a2 tempest-CreateVolumesFromImageTest-2005442537 None] Acquiring lock "cinder-quobyte-65b4c713-9d4e-4485-8320-0f2e3e3f5c60" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9bc0202c-cfb5-4d8f-a281-67e82e8843a2 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "cinder-quobyte-65b4c713-9d4e-4485-8320-0f2e3e3f5c60" acquired by "delete_volume" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:35 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[389d8c3f-15f4-4853-8623-e6751c79e78b]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9bc0202c-cfb5-4d8f-a281-67e82e8843a2 tempest-CreateVolumesFromImageTest-2005442537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-65b4c713-9d4e-4485-8320-0f2e3e3f5c60 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:36 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-44165158-18f4-41fc-a2f5-1b0b56abc3f8 tempest-CreateVolumesFromImageTest-2005442537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.589s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:36 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-44165158-18f4-41fc-a2f5-1b0b56abc3f8 tempest-CreateVolumesFromImageTest-2005442537 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:51:36 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-44165158-18f4-41fc-a2f5-1b0b56abc3f8 tempest-CreateVolumesFromImageTest-2005442537 None] Deleted volume successfully. Sep 05 11:51:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-44165158-18f4-41fc-a2f5-1b0b56abc3f8 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "cinder-ef2d7a22-d33d-4c5b-bb55-b2dc2a227765-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:36 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-65b4c713-9d4e-4485-8320-0f2e3e3f5c60 Sep 05 11:51:36 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:36 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9bc0202c-cfb5-4d8f-a281-67e82e8843a2 tempest-CreateVolumesFromImageTest-2005442537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-65b4c713-9d4e-4485-8320-0f2e3e3f5c60" returned: 0 in 0.603s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9bc0202c-cfb5-4d8f-a281-67e82e8843a2 tempest-CreateVolumesFromImageTest-2005442537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-65b4c713-9d4e-4485-8320-0f2e3e3f5c60 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:36 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-65b4c713-9d4e-4485-8320-0f2e3e3f5c60 Sep 05 11:51:36 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:36 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9bc0202c-cfb5-4d8f-a281-67e82e8843a2 tempest-CreateVolumesFromImageTest-2005442537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-65b4c713-9d4e-4485-8320-0f2e3e3f5c60" returned: 0 in 0.414s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9bc0202c-cfb5-4d8f-a281-67e82e8843a2 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "cinder-quobyte-65b4c713-9d4e-4485-8320-0f2e3e3f5c60" released by "delete_volume" :: held 1.102s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:36 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-9bc0202c-cfb5-4d8f-a281-67e82e8843a2 tempest-CreateVolumesFromImageTest-2005442537 None] Created reservations ['0cecc68e-5e44-487c-bcad-5b1af0eadb30', '7f81e723-72cd-4fbd-8067-deb71c8005a2', '927052e4-adcb-451c-b4e8-64a2a23199a1', '0c623545-30f8-4418-b0f9-70b2e5f91c77'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:51:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9bc0202c-cfb5-4d8f-a281-67e82e8843a2 tempest-CreateVolumesFromImageTest-2005442537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9bc0202c-cfb5-4d8f-a281-67e82e8843a2 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9bc0202c-cfb5-4d8f-a281-67e82e8843a2 tempest-CreateVolumesFromImageTest-2005442537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-9bc0202c-cfb5-4d8f-a281-67e82e8843a2 tempest-CreateVolumesFromImageTest-2005442537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9bc0202c-cfb5-4d8f-a281-67e82e8843a2 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9bc0202c-cfb5-4d8f-a281-67e82e8843a2 tempest-CreateVolumesFromImageTest-2005442537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:37 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:51:37 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:37 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9bc0202c-cfb5-4d8f-a281-67e82e8843a2 tempest-CreateVolumesFromImageTest-2005442537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.300s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:37 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-9bc0202c-cfb5-4d8f-a281-67e82e8843a2 tempest-CreateVolumesFromImageTest-2005442537 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:51:37 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-9bc0202c-cfb5-4d8f-a281-67e82e8843a2 tempest-CreateVolumesFromImageTest-2005442537 None] Deleted volume successfully. Sep 05 11:51:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-9bc0202c-cfb5-4d8f-a281-67e82e8843a2 tempest-CreateVolumesFromImageTest-2005442537 None] Lock "cinder-65b4c713-9d4e-4485-8320-0f2e3e3f5c60-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:37 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:51:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] Flow 'volume_create_manager' (eeaa3515-aa50-48cf-a0b8-497369f4d863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c036f9-755a-4327-a0ce-f5fa1fa30a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c036f9-755a-4327-a0ce-f5fa1fa30a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-110301819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1d538af-ed7b-4119-bb65-373dc0e01b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fa51773c0dc45a3b1927ed009d56a93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:37Z,use_quota=True,user_id='139adcb98f20469da7eb8d30f10f67e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eed6435-559b-4fbe-ae44-f5e2e37d41be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eed6435-559b-4fbe-ae44-f5e2e37d41be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44debf18-665c-4038-9417-09293e229836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44debf18-665c-4038-9417-09293e229836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1d538af-ed7b-4119-bb65-373dc0e01b3b', 'volume_name': 'volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3ab4f76-6e74-448c-841b-da95f4fa5117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3ab4f76-6e74-448c-841b-da95f4fa5117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dc57726-a280-4177-b7c2-9f1d03821dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:37 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] Volume d1d538af-ed7b-4119-bb65-373dc0e01b3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b', 'volume_size': 1} Sep 05 11:51:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-110301819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1d538af-ed7b-4119-bb65-373dc0e01b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fa51773c0dc45a3b1927ed009d56a93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:37Z,use_quota=True,user_id='139adcb98f20469da7eb8d30f10f67e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:51:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] Creating volume d1d538af-ed7b-4119-bb65-373dc0e01b3b {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:51:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:51:37 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:51:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:37 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b 1073741824 Sep 05 11:51:37 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6a2ae19a-6f3d-4da1-b713-e7c0d92ec61a tempest-CreateVolumesFromImageTest-2005442537 None] Acquiring lock "cinder-0c1e7d69-6b90-4bbc-be88-f0ac2b171f24-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6a2ae19a-6f3d-4da1-b713-e7c0d92ec61a tempest-CreateVolumesFromImageTest-2005442537 None] Lock "cinder-0c1e7d69-6b90-4bbc-be88-f0ac2b171f24-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6a2ae19a-6f3d-4da1-b713-e7c0d92ec61a tempest-CreateVolumesFromImageTest-2005442537 None] Acquiring lock "cinder-quobyte-0c1e7d69-6b90-4bbc-be88-f0ac2b171f24" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6a2ae19a-6f3d-4da1-b713-e7c0d92ec61a tempest-CreateVolumesFromImageTest-2005442537 None] Lock "cinder-quobyte-0c1e7d69-6b90-4bbc-be88-f0ac2b171f24" acquired by "delete_volume" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:38 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4165eee2-b6dd-45f7-adea-51a8d17b0f43]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6a2ae19a-6f3d-4da1-b713-e7c0d92ec61a tempest-CreateVolumesFromImageTest-2005442537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0c1e7d69-6b90-4bbc-be88-f0ac2b171f24 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:38 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b 1073741824" returned: 0 in 0.649s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:38 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0c1e7d69-6b90-4bbc-be88-f0ac2b171f24 Sep 05 11:51:38 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:38 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b Sep 05 11:51:38 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:38 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6a2ae19a-6f3d-4da1-b713-e7c0d92ec61a tempest-CreateVolumesFromImageTest-2005442537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0c1e7d69-6b90-4bbc-be88-f0ac2b171f24" returned: 0 in 0.562s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6a2ae19a-6f3d-4da1-b713-e7c0d92ec61a tempest-CreateVolumesFromImageTest-2005442537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0c1e7d69-6b90-4bbc-be88-f0ac2b171f24 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:38 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0c1e7d69-6b90-4bbc-be88-f0ac2b171f24 Sep 05 11:51:38 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:38 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b" returned: 0 in 0.507s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:51:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dc57726-a280-4177-b7c2-9f1d03821dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f7d7aae-635f-4135-b629-3a26d456c242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:38 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] Volume volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b (d1d538af-ed7b-4119-bb65-373dc0e01b3b): created successfully Sep 05 11:51:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f7d7aae-635f-4135-b629-3a26d456c242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:38 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] Flow 'volume_create_manager' (eeaa3515-aa50-48cf-a0b8-497369f4d863) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:38 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-756e2cb9-3bc4-400a-bf15-de33e4a96505 tempest-VolumeDependencyTests-852636625 None] Created volume successfully. Sep 05 11:51:39 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6a2ae19a-6f3d-4da1-b713-e7c0d92ec61a tempest-CreateVolumesFromImageTest-2005442537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0c1e7d69-6b90-4bbc-be88-f0ac2b171f24" returned: 0 in 0.460s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6a2ae19a-6f3d-4da1-b713-e7c0d92ec61a tempest-CreateVolumesFromImageTest-2005442537 None] Lock "cinder-quobyte-0c1e7d69-6b90-4bbc-be88-f0ac2b171f24" released by "delete_volume" :: held 1.089s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:39 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-6a2ae19a-6f3d-4da1-b713-e7c0d92ec61a tempest-CreateVolumesFromImageTest-2005442537 None] Created reservations ['9774f547-4bbe-4da2-afe4-7510b0f2eb05', '95012c99-e7aa-44b4-a02e-c4dccf7df5c0', '8faf67ad-ec58-45e7-9d7b-acaa126ec1d9', 'e4806740-188d-405f-9e31-d1b106a78ab6'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:51:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6a2ae19a-6f3d-4da1-b713-e7c0d92ec61a tempest-CreateVolumesFromImageTest-2005442537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6a2ae19a-6f3d-4da1-b713-e7c0d92ec61a tempest-CreateVolumesFromImageTest-2005442537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6a2ae19a-6f3d-4da1-b713-e7c0d92ec61a tempest-CreateVolumesFromImageTest-2005442537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-6a2ae19a-6f3d-4da1-b713-e7c0d92ec61a tempest-CreateVolumesFromImageTest-2005442537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-6a2ae19a-6f3d-4da1-b713-e7c0d92ec61a tempest-CreateVolumesFromImageTest-2005442537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6a2ae19a-6f3d-4da1-b713-e7c0d92ec61a tempest-CreateVolumesFromImageTest-2005442537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:39 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:51:39 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:39 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-6a2ae19a-6f3d-4da1-b713-e7c0d92ec61a tempest-CreateVolumesFromImageTest-2005442537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.297s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:39 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-6a2ae19a-6f3d-4da1-b713-e7c0d92ec61a tempest-CreateVolumesFromImageTest-2005442537 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:51:39 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-6a2ae19a-6f3d-4da1-b713-e7c0d92ec61a tempest-CreateVolumesFromImageTest-2005442537 None] Deleted volume successfully. Sep 05 11:51:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-6a2ae19a-6f3d-4da1-b713-e7c0d92ec61a tempest-CreateVolumesFromImageTest-2005442537 None] Lock "cinder-0c1e7d69-6b90-4bbc-be88-f0ac2b171f24-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-73c82b0f-be19-43ac-8598-5bbf532a32a2 tempest-VolumeDependencyTests-852636625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-73c82b0f-be19-43ac-8598-5bbf532a32a2 tempest-VolumeDependencyTests-852636625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-73c82b0f-be19-43ac-8598-5bbf532a32a2 tempest-VolumeDependencyTests-852636625 None] Creating offline snapshot 8baab04f-0895-4355-b306-626931873d18 of volume d1d538af-ed7b-4119-bb65-373dc0e01b3b {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:51:39 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9ffa21-3b67-415f-aaa7-5ad1147f0e80]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-73c82b0f-be19-43ac-8598-5bbf532a32a2 tempest-VolumeDependencyTests-852636625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:39 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b Sep 05 11:51:39 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:40 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-73c82b0f-be19-43ac-8598-5bbf532a32a2 tempest-VolumeDependencyTests-852636625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b" returned: 0 in 0.374s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-73c82b0f-be19-43ac-8598-5bbf532a32a2 tempest-VolumeDependencyTests-852636625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b.8baab04f-0895-4355-b306-626931873d18 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:40 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b.8baab04f-0895-4355-b306-626931873d18 1G Sep 05 11:51:40 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:40 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-73c82b0f-be19-43ac-8598-5bbf532a32a2 tempest-VolumeDependencyTests-852636625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b.8baab04f-0895-4355-b306-626931873d18 1G" returned: 0 in 0.688s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-73c82b0f-be19-43ac-8598-5bbf532a32a2 tempest-VolumeDependencyTests-852636625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b.8baab04f-0895-4355-b306-626931873d18 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:40 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b.8baab04f-0895-4355-b306-626931873d18 Sep 05 11:51:40 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:41 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-73c82b0f-be19-43ac-8598-5bbf532a32a2 tempest-VolumeDependencyTests-852636625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b.8baab04f-0895-4355-b306-626931873d18" returned: 0 in 0.380s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:41 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-73c82b0f-be19-43ac-8598-5bbf532a32a2 tempest-VolumeDependencyTests-852636625 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b.8baab04f-0895-4355-b306-626931873d18 is being set with open permissions: ugo+rw Sep 05 11:51:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-73c82b0f-be19-43ac-8598-5bbf532a32a2 tempest-VolumeDependencyTests-852636625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b.8baab04f-0895-4355-b306-626931873d18 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:41 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b.8baab04f-0895-4355-b306-626931873d18 Sep 05 11:51:41 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:41 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-73c82b0f-be19-43ac-8598-5bbf532a32a2 tempest-VolumeDependencyTests-852636625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b.8baab04f-0895-4355-b306-626931873d18" returned: 0 in 0.417s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-73c82b0f-be19-43ac-8598-5bbf532a32a2 tempest-VolumeDependencyTests-852636625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:41 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b.info Sep 05 11:51:41 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:42 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-73c82b0f-be19-43ac-8598-5bbf532a32a2 tempest-VolumeDependencyTests-852636625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b.info" returned: 0 in 0.276s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:42 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-73c82b0f-be19-43ac-8598-5bbf532a32a2 tempest-VolumeDependencyTests-852636625 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b.info is being set with open permissions: ugo+rw Sep 05 11:51:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-73c82b0f-be19-43ac-8598-5bbf532a32a2 tempest-VolumeDependencyTests-852636625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:42 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b.info Sep 05 11:51:42 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:42 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-73c82b0f-be19-43ac-8598-5bbf532a32a2 tempest-VolumeDependencyTests-852636625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b.info" returned: 0 in 0.304s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-73c82b0f-be19-43ac-8598-5bbf532a32a2 tempest-VolumeDependencyTests-852636625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.544s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:42 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-73c82b0f-be19-43ac-8598-5bbf532a32a2 tempest-VolumeDependencyTests-852636625 None] Create snapshot completed successfully Sep 05 11:51:43 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:51:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Flow 'volume_create_manager' (57ab95b4-c2e1-4d61-a9c0-df6598e55e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc9f844-d56b-4c94-9da0-e14493a189c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc9f844-d56b-4c94-9da0-e14493a189c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-422871378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a5176d0-629b-4656-8eab-8ce710fec0f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fa51773c0dc45a3b1927ed009d56a93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8baab04f-0895-4355-b306-626931873d18,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:44Z,use_quota=True,user_id='139adcb98f20469da7eb8d30f10f67e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc74730c-c714-423e-950d-556b34f576da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc74730c-c714-423e-950d-556b34f576da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07123b8f-45bc-4ff2-9dda-ff1d7fab1e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07123b8f-45bc-4ff2-9dda-ff1d7fab1e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1a5176d0-629b-4656-8eab-8ce710fec0f6', 'volume_name': 'volume-1a5176d0-629b-4656-8eab-8ce710fec0f6', 'volume_size': 1, 'snapshot_id': '8baab04f-0895-4355-b306-626931873d18'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3faa801-480d-46bc-820b-e7fda82cbf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3faa801-480d-46bc-820b-e7fda82cbf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3591a477-af99-4159-b129-f2b072c97a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:43 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Volume 1a5176d0-629b-4656-8eab-8ce710fec0f6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1a5176d0-629b-4656-8eab-8ce710fec0f6', 'volume_size': 1, 'snapshot_id': '8baab04f-0895-4355-b306-626931873d18'} Sep 05 11:51:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Acquiring lock "cinder-quobyte-8baab04f-0895-4355-b306-626931873d18-1a5176d0-629b-4656-8eab-8ce710fec0f6" by "_create_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Lock "cinder-quobyte-8baab04f-0895-4355-b306-626931873d18-1a5176d0-629b-4656-8eab-8ce710fec0f6" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Creating volume 1a5176d0-629b-4656-8eab-8ce710fec0f6 from snapshot 8baab04f-0895-4355-b306-626931873d18 {{(pid=87517) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 11:51:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:51:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Acquiring lock "cinder-quobyte-1a5176d0-629b-4656-8eab-8ce710fec0f6" by "_copy_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:44 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Lock "cinder-quobyte-1a5176d0-629b-4656-8eab-8ce710fec0f6" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] snapshot: 8baab04f-0895-4355-b306-626931873d18, volume: 1a5176d0-629b-4656-8eab-8ce710fec0f6, {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 11:51:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:44 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff3136a-7a58-4e13-9a31-0875f31f2dea]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b.8baab04f-0895-4355-b306-626931873d18 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:44 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b.8baab04f-0895-4355-b306-626931873d18 Sep 05 11:51:44 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:44 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b.8baab04f-0895-4355-b306-626931873d18" returned: 0 in 0.585s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:51:44 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccabd94a-e49b-44e1-a52a-0e50440c2239]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:44 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b Sep 05 11:51:44 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:45 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b" returned: 0 in 0.446s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 11:51:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Creating direct copy from snapshot {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 11:51:45 devstack cinder-volume[87517]: DEBUG cinder.utils [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Path /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1a5176d0-629b-4656-8eab-8ce710fec0f6 not found in is_blk_device check {{(pid=87517) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 11:51:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1a5176d0-629b-4656-8eab-8ce710fec0f6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:45 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1a5176d0-629b-4656-8eab-8ce710fec0f6 Sep 05 11:51:45 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:51 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1a5176d0-629b-4656-8eab-8ce710fec0f6" returned: 0 in 6.177s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:51 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Image conversion details: src /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b, size 1024.00 MB, duration 6.18 sec, destination /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1a5176d0-629b-4656-8eab-8ce710fec0f6 {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 11:51:51 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Converted 1024.00 MB image at 165.66 MB/s Sep 05 11:51:51 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1a5176d0-629b-4656-8eab-8ce710fec0f6 is being set with open permissions: ugo+rw Sep 05 11:51:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1a5176d0-629b-4656-8eab-8ce710fec0f6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:51 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1a5176d0-629b-4656-8eab-8ce710fec0f6 Sep 05 11:51:51 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:51 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1a5176d0-629b-4656-8eab-8ce710fec0f6" returned: 0 in 0.401s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:51 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Lock "cinder-quobyte-1a5176d0-629b-4656-8eab-8ce710fec0f6" released by "_copy_volume_from_snapshot" :: held 7.730s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:51 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Lock "cinder-quobyte-8baab04f-0895-4355-b306-626931873d18-1a5176d0-629b-4656-8eab-8ce710fec0f6" released by "_create_volume_from_snapshot" :: held 7.812s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.835s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3591a477-af99-4159-b129-f2b072c97a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a5176d0-629b-4656-8eab-8ce710fec0f6', 'volume_size': 1, 'snapshot_id': '8baab04f-0895-4355-b306-626931873d18'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e057dc3e-5cc9-416f-ad9e-467aad85f211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:51 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Volume volume-1a5176d0-629b-4656-8eab-8ce710fec0f6 (1a5176d0-629b-4656-8eab-8ce710fec0f6): created successfully Sep 05 11:51:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e057dc3e-5cc9-416f-ad9e-467aad85f211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Flow 'volume_create_manager' (57ab95b4-c2e1-4d61-a9c0-df6598e55e8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:51 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-46382f45-f8e0-41a6-98d0-f1911b3862c9 tempest-VolumeDependencyTests-852636625 None] Created volume successfully. Sep 05 11:51:52 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=159,cinder:UPDATE=236,cinder:DELETE=21,cinder:INSERT=69 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:51:52 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:51:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Flow 'volume_create_manager' (d10f375d-ed74-4d37-b0c9-a9e33d50d756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c359d418-30fb-4c81-8c31-ca20ab61a60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c359d418-30fb-4c81-8c31-ca20ab61a60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8a86786-6173-4ad9-ac26-e16ed5f351fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8846794a28814033b2b39b4ea50991bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:52Z,use_quota=True,user_id='cacf92095a5a4c7d8e21c5375a1efdf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb2dc5b-20d9-4704-8fc2-542ee8501cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb2dc5b-20d9-4704-8fc2-542ee8501cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1d89d45-2d3e-4a3b-be9a-5bec1dcb41c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:52 devstack cinder-volume[87517]: DEBUG cinder.image.glance [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Creating Keystone auth plugin from conf {{(pid=87517) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 11:51:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1d89d45-2d3e-4a3b-be9a-5bec1dcb41c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b8a86786-6173-4ad9-ac26-e16ed5f351fa', 'volume_name': 'volume-b8a86786-6173-4ad9-ac26-e16ed5f351fa', 'volume_size': 1, 'image_id': '283ade04-2f67-4d88-b692-4a63bd997551', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/283ade04-2f67-4d88-b692-4a63bd997551', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6e6b97a9a2cebf17f1eca6d069abae63', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8846794a28814033b2b39b4ea50991bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '91e08f23d6da1d848a8db78d692ba4479cc071c53cba77fa6704235ca8f30c1e8b7fd44f83498630a80cdd7d756d12475c3303bfba35cdf0251ca75f3265760c', 'id': '283ade04-2f67-4d88-b692-4a63bd997551', 'created_at': datetime.datetime(2026, 9, 5, 9, 51, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 9, 51, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/283ade04-2f67-4d88-b692-4a63bd997551/file', 'properties': {}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a3b3e4-567d-46a8-8efe-1453d7a5c83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a3b3e4-567d-46a8-8efe-1453d7a5c83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:52 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ead288dd-621e-4afc-80ef-7728cb099d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:52 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Volume b8a86786-6173-4ad9-ac26-e16ed5f351fa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b8a86786-6173-4ad9-ac26-e16ed5f351fa', 'volume_size': 1, 'image_id': '283ade04-2f67-4d88-b692-4a63bd997551', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/283ade04-2f67-4d88-b692-4a63bd997551', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6e6b97a9a2cebf17f1eca6d069abae63', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8846794a28814033b2b39b4ea50991bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '91e08f23d6da1d848a8db78d692ba4479cc071c53cba77fa6704235ca8f30c1e8b7fd44f83498630a80cdd7d756d12475c3303bfba35cdf0251ca75f3265760c', 'id': '283ade04-2f67-4d88-b692-4a63bd997551', 'created_at': datetime.datetime(2026, 9, 5, 9, 51, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 9, 51, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/283ade04-2f67-4d88-b692-4a63bd997551/file', 'properties': {}}, 'image_service': } Sep 05 11:51:52 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Trying to clone b8a86786-6173-4ad9-ac26-e16ed5f351fa from image 283ade04-2f67-4d88-b692-4a63bd997551 at location (None, [{'url': 'file:///opt/stack/data/glance/images/283ade04-2f67-4d88-b692-4a63bd997551', 'metadata': {}}]). {{(pid=87517) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 11:51:52 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_283ade04-2f67-4d88-b692-4a63bd997551_kkyu1q0xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 11:51:52 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Image download 0.00 MB at 0.00 MB/s Sep 05 11:51:52 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac28906-41b7-4af1-9284-dad534364181]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_283ade04-2f67-4d88-b692-4a63bd997551_kkyu1q0xdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:52 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_283ade04-2f67-4d88-b692-4a63bd997551_kkyu1q0xdevstack@QuobyteHD Sep 05 11:51:52 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8f1e045e-fd7f-420c-80ef-15946667f4be tempest-VolumeDependencyTests-852636625 None] Acquiring lock "cinder-8baab04f-0895-4355-b306-626931873d18-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:53 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8f1e045e-fd7f-420c-80ef-15946667f4be tempest-VolumeDependencyTests-852636625 None] Lock "cinder-8baab04f-0895-4355-b306-626931873d18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8f1e045e-fd7f-420c-80ef-15946667f4be tempest-VolumeDependencyTests-852636625 None] Acquiring lock "cinder-quobyte-d1d538af-ed7b-4119-bb65-373dc0e01b3b" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_283ade04-2f67-4d88-b692-4a63bd997551_kkyu1q0xdevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_283ade04-2f67-4d88-b692-4a63bd997551_kkyu1q0xdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8f1e045e-fd7f-420c-80ef-15946667f4be tempest-VolumeDependencyTests-852636625 None] Lock "cinder-quobyte-d1d538af-ed7b-4119-bb65-373dc0e01b3b" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8f1e045e-fd7f-420c-80ef-15946667f4be tempest-VolumeDependencyTests-852636625 None] Acquiring lock "cinder-quobyte-8baab04f-0895-4355-b306-626931873d18" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8f1e045e-fd7f-420c-80ef-15946667f4be tempest-VolumeDependencyTests-852636625 None] Lock "cinder-quobyte-8baab04f-0895-4355-b306-626931873d18" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-8f1e045e-fd7f-420c-80ef-15946667f4be tempest-VolumeDependencyTests-852636625 None] Deleting offline snapshot 8baab04f-0895-4355-b306-626931873d18 of volume d1d538af-ed7b-4119-bb65-373dc0e01b3b {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:51:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-8f1e045e-fd7f-420c-80ef-15946667f4be tempest-VolumeDependencyTests-852636625 None] snapshot_file for this snap is: volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b.8baab04f-0895-4355-b306-626931873d18 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:51:53 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3be9eba-6572-4e2f-9bef-54a65c8ec3c8]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8f1e045e-fd7f-420c-80ef-15946667f4be tempest-VolumeDependencyTests-852636625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b.8baab04f-0895-4355-b306-626931873d18 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:53 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_283ade04-2f67-4d88-b692-4a63bd997551_kkyu1q0xdevstack@QuobyteHD Sep 05 11:51:53 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:53 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b.8baab04f-0895-4355-b306-626931873d18 Sep 05 11:51:53 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:53 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_283ade04-2f67-4d88-b692-4a63bd997551_kkyu1q0xdevstack@QuobyteHD" returned: 1 in 0.390s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_283ade04-2f67-4d88-b692-4a63bd997551_kkyu1q0xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 11:51:53 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Temporary image 283ade04-2f67-4d88-b692-4a63bd997551 is fetched for user cacf92095a5a4c7d8e21c5375a1efdf0. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 11:51:53 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=238,cinder:SELECT=173,cinder:INSERT=49,cinder:DELETE=23 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:51:53 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9e5ebd-7408-4eda-a83b-fae6216c67eb]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_283ade04-2f67-4d88-b692-4a63bd997551_kkyu1q0xdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:53 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8f1e045e-fd7f-420c-80ef-15946667f4be tempest-VolumeDependencyTests-852636625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b.8baab04f-0895-4355-b306-626931873d18" returned: 0 in 0.441s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-8f1e045e-fd7f-420c-80ef-15946667f4be tempest-VolumeDependencyTests-852636625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:51:53 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8613b1-5080-437b-9207-fcb9f3249912]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8f1e045e-fd7f-420c-80ef-15946667f4be tempest-VolumeDependencyTests-852636625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:53 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_283ade04-2f67-4d88-b692-4a63bd997551_kkyu1q0xdevstack@QuobyteHD Sep 05 11:51:53 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:53 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b Sep 05 11:51:53 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:54 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_283ade04-2f67-4d88-b692-4a63bd997551_kkyu1q0xdevstack@QuobyteHD" returned: 0 in 0.417s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_283ade04-2f67-4d88-b692-4a63bd997551_kkyu1q0xdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:54 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_283ade04-2f67-4d88-b692-4a63bd997551_kkyu1q0xdevstack@QuobyteHD Sep 05 11:51:54 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:54 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8f1e045e-fd7f-420c-80ef-15946667f4be tempest-VolumeDependencyTests-852636625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b" returned: 0 in 0.631s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8f1e045e-fd7f-420c-80ef-15946667f4be tempest-VolumeDependencyTests-852636625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b.8baab04f-0895-4355-b306-626931873d18 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:54 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b.8baab04f-0895-4355-b306-626931873d18 Sep 05 11:51:54 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:54 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_283ade04-2f67-4d88-b692-4a63bd997551_kkyu1q0xdevstack@QuobyteHD" returned: 1 in 0.431s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_283ade04-2f67-4d88-b692-4a63bd997551_kkyu1q0xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 11:51:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8a86786-6173-4ad9-ac26-e16ed5f351fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8846794a28814033b2b39b4ea50991bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:52Z,use_quota=True,user_id='cacf92095a5a4c7d8e21c5375a1efdf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:51:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Creating volume b8a86786-6173-4ad9-ac26-e16ed5f351fa {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:51:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:54 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:51:54 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:51:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b8a86786-6173-4ad9-ac26-e16ed5f351fa 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:54 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b8a86786-6173-4ad9-ac26-e16ed5f351fa 1073741824 Sep 05 11:51:54 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:54 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8f1e045e-fd7f-420c-80ef-15946667f4be tempest-VolumeDependencyTests-852636625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b.8baab04f-0895-4355-b306-626931873d18" returned: 0 in 0.434s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8f1e045e-fd7f-420c-80ef-15946667f4be tempest-VolumeDependencyTests-852636625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b.8baab04f-0895-4355-b306-626931873d18 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:54 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b.8baab04f-0895-4355-b306-626931873d18 Sep 05 11:51:54 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:55 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8f1e045e-fd7f-420c-80ef-15946667f4be tempest-VolumeDependencyTests-852636625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b.8baab04f-0895-4355-b306-626931873d18" returned: 0 in 0.348s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8f1e045e-fd7f-420c-80ef-15946667f4be tempest-VolumeDependencyTests-852636625 None] Lock "cinder-quobyte-8baab04f-0895-4355-b306-626931873d18" released by "_delete_snapshot" :: held 2.003s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:55 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b8a86786-6173-4ad9-ac26-e16ed5f351fa 1073741824" returned: 0 in 0.664s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8f1e045e-fd7f-420c-80ef-15946667f4be tempest-VolumeDependencyTests-852636625 None] Lock "cinder-quobyte-d1d538af-ed7b-4119-bb65-373dc0e01b3b" released by "delete_snapshot" :: held 2.044s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b8a86786-6173-4ad9-ac26-e16ed5f351fa {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:55 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b8a86786-6173-4ad9-ac26-e16ed5f351fa Sep 05 11:51:55 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:55 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-8f1e045e-fd7f-420c-80ef-15946667f4be tempest-VolumeDependencyTests-852636625 None] Created reservations ['d16278aa-6127-4820-87e0-86b04190ea52', '2181486a-61f6-4765-ae9c-f90f1e93a5e2', 'a6ff0f05-9452-41ce-ba98-68b24c3d8bd7', 'ed242651-8d44-4a18-bb75-962a5bdee9bf'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:51:55 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-8f1e045e-fd7f-420c-80ef-15946667f4be tempest-VolumeDependencyTests-852636625 None] Delete snapshot completed successfully. Sep 05 11:51:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8f1e045e-fd7f-420c-80ef-15946667f4be tempest-VolumeDependencyTests-852636625 None] Lock "cinder-8baab04f-0895-4355-b306-626931873d18-delete_snapshot" released by "delete_snapshot" :: held 2.290s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:55 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b8a86786-6173-4ad9-ac26-e16ed5f351fa" returned: 0 in 0.321s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:51:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:55 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Attempting download of 283ade04-2f67-4d88-b692-4a63bd997551 ((None, [{'url': 'file:///opt/stack/data/glance/images/283ade04-2f67-4d88-b692-4a63bd997551', 'metadata': {}}])) to volume b8a86786-6173-4ad9-ac26-e16ed5f351fa. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 11:51:55 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1a20bf-574e-4a72-b132-1ab547a202b4]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_283ade04-2f67-4d88-b692-4a63bd997551_3w0f4haq {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:55 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_283ade04-2f67-4d88-b692-4a63bd997551_3w0f4haq Sep 05 11:51:55 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:56 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_283ade04-2f67-4d88-b692-4a63bd997551_3w0f4haq" returned: 0 in 0.372s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_283ade04-2f67-4d88-b692-4a63bd997551_3w0f4haq {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:56 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_283ade04-2f67-4d88-b692-4a63bd997551_3w0f4haq Sep 05 11:51:56 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c3c9dee7-0c18-4bda-bce2-82ffc8390ec5 tempest-VolumeDependencyTests-852636625 None] Acquiring lock "cinder-d1d538af-ed7b-4119-bb65-373dc0e01b3b-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c3c9dee7-0c18-4bda-bce2-82ffc8390ec5 tempest-VolumeDependencyTests-852636625 None] Lock "cinder-d1d538af-ed7b-4119-bb65-373dc0e01b3b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c3c9dee7-0c18-4bda-bce2-82ffc8390ec5 tempest-VolumeDependencyTests-852636625 None] Acquiring lock "cinder-quobyte-d1d538af-ed7b-4119-bb65-373dc0e01b3b" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c3c9dee7-0c18-4bda-bce2-82ffc8390ec5 tempest-VolumeDependencyTests-852636625 None] Lock "cinder-quobyte-d1d538af-ed7b-4119-bb65-373dc0e01b3b" acquired by "delete_volume" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:56 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_283ade04-2f67-4d88-b692-4a63bd997551_3w0f4haq" returned: 1 in 0.443s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_283ade04-2f67-4d88-b692-4a63bd997551_3w0f4haq' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 11:51:56 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1c572b-0ed1-4d2d-a228-458b4d33af0b]: (4, 'raw') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_283ade04-2f67-4d88-b692-4a63bd997551_kkyu1q0xdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:56 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d681ba80-7526-4092-979c-3f39feedbba1]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3c9dee7-0c18-4bda-bce2-82ffc8390ec5 tempest-VolumeDependencyTests-852636625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:56 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_283ade04-2f67-4d88-b692-4a63bd997551_kkyu1q0xdevstack@QuobyteHD Sep 05 11:51:56 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:56 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b Sep 05 11:51:56 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:57 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_283ade04-2f67-4d88-b692-4a63bd997551_kkyu1q0xdevstack@QuobyteHD" returned: 0 in 0.424s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_283ade04-2f67-4d88-b692-4a63bd997551_kkyu1q0xdevstack@QuobyteHD {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:57 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3c9dee7-0c18-4bda-bce2-82ffc8390ec5 tempest-VolumeDependencyTests-852636625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b" returned: 0 in 0.487s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3c9dee7-0c18-4bda-bce2-82ffc8390ec5 tempest-VolumeDependencyTests-852636625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:57 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b Sep 05 11:51:57 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:57 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_283ade04-2f67-4d88-b692-4a63bd997551_kkyu1q0xdevstack@QuobyteHD Sep 05 11:51:57 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:57 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3c9dee7-0c18-4bda-bce2-82ffc8390ec5 tempest-VolumeDependencyTests-852636625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d1d538af-ed7b-4119-bb65-373dc0e01b3b" returned: 0 in 0.315s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c3c9dee7-0c18-4bda-bce2-82ffc8390ec5 tempest-VolumeDependencyTests-852636625 None] Lock "cinder-quobyte-d1d538af-ed7b-4119-bb65-373dc0e01b3b" released by "delete_volume" :: held 0.912s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:57 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:57 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-c3c9dee7-0c18-4bda-bce2-82ffc8390ec5 tempest-VolumeDependencyTests-852636625 None] Created reservations ['0c0ea6a5-d38a-4783-b8c4-0df31b0faa6e', 'ef54c4ba-c388-481c-acf0-45f7f0ead3fb', '683d5ca5-31a6-47e4-b525-72d96f9b353a', 'bd95ea91-7f35-49b6-938c-bfd8e1136aaa'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:51:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_283ade04-2f67-4d88-b692-4a63bd997551_kkyu1q0xdevstack@QuobyteHD" returned: 1 in 0.529s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_283ade04-2f67-4d88-b692-4a63bd997551_kkyu1q0xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 11:51:57 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] 283ade04-2f67-4d88-b692-4a63bd997551 was raw, converting to qcow2 {{(pid=87517) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 11:51:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_283ade04-2f67-4d88-b692-4a63bd997551_kkyu1q0xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b8a86786-6173-4ad9-ac26-e16ed5f351fa {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:57 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_283ade04-2f67-4d88-b692-4a63bd997551_kkyu1q0xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b8a86786-6173-4ad9-ac26-e16ed5f351fa Sep 05 11:51:57 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c3c9dee7-0c18-4bda-bce2-82ffc8390ec5 tempest-VolumeDependencyTests-852636625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c3c9dee7-0c18-4bda-bce2-82ffc8390ec5 tempest-VolumeDependencyTests-852636625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c3c9dee7-0c18-4bda-bce2-82ffc8390ec5 tempest-VolumeDependencyTests-852636625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c3c9dee7-0c18-4bda-bce2-82ffc8390ec5 tempest-VolumeDependencyTests-852636625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c3c9dee7-0c18-4bda-bce2-82ffc8390ec5 tempest-VolumeDependencyTests-852636625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3c9dee7-0c18-4bda-bce2-82ffc8390ec5 tempest-VolumeDependencyTests-852636625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:57 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:51:57 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:57 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c3c9dee7-0c18-4bda-bce2-82ffc8390ec5 tempest-VolumeDependencyTests-852636625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.308s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:57 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-c3c9dee7-0c18-4bda-bce2-82ffc8390ec5 tempest-VolumeDependencyTests-852636625 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:51:57 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c3c9dee7-0c18-4bda-bce2-82ffc8390ec5 tempest-VolumeDependencyTests-852636625 None] Deleted volume successfully. Sep 05 11:51:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c3c9dee7-0c18-4bda-bce2-82ffc8390ec5 tempest-VolumeDependencyTests-852636625 None] Lock "cinder-d1d538af-ed7b-4119-bb65-373dc0e01b3b-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:58 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_283ade04-2f67-4d88-b692-4a63bd997551_kkyu1q0xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b8a86786-6173-4ad9-ac26-e16ed5f351fa" returned: 0 in 0.597s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_283ade04-2f67-4d88-b692-4a63bd997551_kkyu1q0xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b8a86786-6173-4ad9-ac26-e16ed5f351fa {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 11:51:58 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Converted 0.00 MB image at 0.00 MB/s Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b8a86786-6173-4ad9-ac26-e16ed5f351fa 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:58 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b8a86786-6173-4ad9-ac26-e16ed5f351fa 1G Sep 05 11:51:58 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] Flow 'volume_create_manager' (69a98a5e-7698-4056-b46a-2c06eb2459af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec9b1c91-6b17-4228-a117-d5422f6e809d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec9b1c91-6b17-4228-a117-d5422f6e809d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1051624252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83ef4a72-29f0-42ae-99be-9b168541d15a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fe76998b69442d7b93f066cdcd76c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:58Z,use_quota=True,user_id='f1895e35113245d59d3fc50f3a686e64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7bacfc4-36ef-4205-8fc4-adf474f4c163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7bacfc4-36ef-4205-8fc4-adf474f4c163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f77691a-26b1-4be4-9e4f-8e3a81a007c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f77691a-26b1-4be4-9e4f-8e3a81a007c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83ef4a72-29f0-42ae-99be-9b168541d15a', 'volume_name': 'volume-83ef4a72-29f0-42ae-99be-9b168541d15a', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de26eaf-f217-416f-ac7e-54885ef7b25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de26eaf-f217-416f-ac7e-54885ef7b25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (897640a5-5635-4e5f-9566-af469ad2fe7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:58 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] Volume 83ef4a72-29f0-42ae-99be-9b168541d15a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83ef4a72-29f0-42ae-99be-9b168541d15a', 'volume_size': 1} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1051624252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83ef4a72-29f0-42ae-99be-9b168541d15a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fe76998b69442d7b93f066cdcd76c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:51:58Z,use_quota=True,user_id='f1895e35113245d59d3fc50f3a686e64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] Creating volume 83ef4a72-29f0-42ae-99be-9b168541d15a {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:51:58 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:58 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b8a86786-6173-4ad9-ac26-e16ed5f351fa 1G" returned: 0 in 0.403s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Downloaded image 283ade04-2f67-4d88-b692-4a63bd997551 ((None, [{'url': 'file:///opt/stack/data/glance/images/283ade04-2f67-4d88-b692-4a63bd997551', 'metadata': {}}])) to volume b8a86786-6173-4ad9-ac26-e16ed5f351fa successfully. {{(pid=87517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Temporary image 283ade04-2f67-4d88-b692-4a63bd997551 for user cacf92095a5a4c7d8e21c5375a1efdf0 is deleted. {{(pid=87517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.volume_utils [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Marking volume b8a86786-6173-4ad9-ac26-e16ed5f351fa as bootable. {{(pid=87517) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 11:51:58 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a 1073741824 Sep 05 11:51:58 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Copying metadata from image 283ade04-2f67-4d88-b692-4a63bd997551 to b8a86786-6173-4ad9-ac26-e16ed5f351fa. {{(pid=87517) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Creating volume glance metadata for volume b8a86786-6173-4ad9-ac26-e16ed5f351fa backed by image 283ade04-2f67-4d88-b692-4a63bd997551 with: {'image_id': '283ade04-2f67-4d88-b692-4a63bd997551', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '6e6b97a9a2cebf17f1eca6d069abae63', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87517) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ead288dd-621e-4afc-80ef-7728cb099d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8a86786-6173-4ad9-ac26-e16ed5f351fa', 'volume_size': 1, 'image_id': '283ade04-2f67-4d88-b692-4a63bd997551', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/283ade04-2f67-4d88-b692-4a63bd997551', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6e6b97a9a2cebf17f1eca6d069abae63', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8846794a28814033b2b39b4ea50991bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '91e08f23d6da1d848a8db78d692ba4479cc071c53cba77fa6704235ca8f30c1e8b7fd44f83498630a80cdd7d756d12475c3303bfba35cdf0251ca75f3265760c', 'id': '283ade04-2f67-4d88-b692-4a63bd997551', 'created_at': datetime.datetime(2026, 9, 5, 9, 51, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 9, 51, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/283ade04-2f67-4d88-b692-4a63bd997551/file', 'properties': {}}, 'image_service': }' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db97e87-439d-49a5-af70-93501a9529d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e0d9936a-6e04-4875-8a2a-e000d8a83a32 tempest-VolumeDependencyTests-852636625 None] Acquiring lock "cinder-1a5176d0-629b-4656-8eab-8ce710fec0f6-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:58 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Volume volume-b8a86786-6173-4ad9-ac26-e16ed5f351fa (b8a86786-6173-4ad9-ac26-e16ed5f351fa): created successfully Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db97e87-439d-49a5-af70-93501a9529d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Flow 'volume_create_manager' (d10f375d-ed74-4d37-b0c9-a9e33d50d756) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e0d9936a-6e04-4875-8a2a-e000d8a83a32 tempest-VolumeDependencyTests-852636625 None] Lock "cinder-1a5176d0-629b-4656-8eab-8ce710fec0f6-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:58 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-170581e3-ef5b-4699-aac9-f445c485fcfc tempest-VolumeImageDependencyTests-1040721897 None] Created volume successfully. Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e0d9936a-6e04-4875-8a2a-e000d8a83a32 tempest-VolumeDependencyTests-852636625 None] Acquiring lock "cinder-quobyte-1a5176d0-629b-4656-8eab-8ce710fec0f6" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e0d9936a-6e04-4875-8a2a-e000d8a83a32 tempest-VolumeDependencyTests-852636625 None] Lock "cinder-quobyte-1a5176d0-629b-4656-8eab-8ce710fec0f6" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b3c457-bb55-4885-b96b-e8f8fb39dfdf]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e0d9936a-6e04-4875-8a2a-e000d8a83a32 tempest-VolumeDependencyTests-852636625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1a5176d0-629b-4656-8eab-8ce710fec0f6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:58 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1a5176d0-629b-4656-8eab-8ce710fec0f6 Sep 05 11:51:58 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:59 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a 1073741824" returned: 0 in 0.529s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:59 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a Sep 05 11:51:59 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:59 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e0d9936a-6e04-4875-8a2a-e000d8a83a32 tempest-VolumeDependencyTests-852636625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1a5176d0-629b-4656-8eab-8ce710fec0f6" returned: 0 in 0.410s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e0d9936a-6e04-4875-8a2a-e000d8a83a32 tempest-VolumeDependencyTests-852636625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1a5176d0-629b-4656-8eab-8ce710fec0f6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:59 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1a5176d0-629b-4656-8eab-8ce710fec0f6 Sep 05 11:51:59 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:59 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a" returned: 0 in 0.283s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:51:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (897640a5-5635-4e5f-9566-af469ad2fe7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83ef4a72-29f0-42ae-99be-9b168541d15a', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8691e8d-1c98-4282-a3f5-3d4b82759ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:51:59 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] Volume volume-83ef4a72-29f0-42ae-99be-9b168541d15a (83ef4a72-29f0-42ae-99be-9b168541d15a): created successfully Sep 05 11:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8691e8d-1c98-4282-a3f5-3d4b82759ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] Flow 'volume_create_manager' (69a98a5e-7698-4056-b46a-2c06eb2459af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:51:59 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c6c597e9-9c96-4fad-9c9a-b1fff859e484 tempest-SnapshotDependencyTests-1364943872 None] Created volume successfully. Sep 05 11:51:59 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Sep 05 11:51:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e0d9936a-6e04-4875-8a2a-e000d8a83a32 tempest-VolumeDependencyTests-852636625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-1a5176d0-629b-4656-8eab-8ce710fec0f6" returned: 0 in 0.263s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:51:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e0d9936a-6e04-4875-8a2a-e000d8a83a32 tempest-VolumeDependencyTests-852636625 None] Lock "cinder-quobyte-1a5176d0-629b-4656-8eab-8ce710fec0f6" released by "delete_volume" :: held 0.723s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:51:59 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-e0d9936a-6e04-4875-8a2a-e000d8a83a32 tempest-VolumeDependencyTests-852636625 None] Created reservations ['ca123559-3565-4d70-bc00-6c808001d159', 'b39b8086-e2d0-4891-bcc8-56071e32ae86', 'f5023882-8118-4b5d-804c-492d72a6ece1', '1e4230bd-12ac-4557-832c-1710d4a98145'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:51:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-dc048513-b3f8-494b-ac4e-991d9e1395b8 tempest-VolumeImageDependencyTests-1040721897 None] Acquiring lock "cinder-b8a86786-6173-4ad9-ac26-e16ed5f351fa-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e0d9936a-6e04-4875-8a2a-e000d8a83a32 tempest-VolumeDependencyTests-852636625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:51:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e0d9936a-6e04-4875-8a2a-e000d8a83a32 tempest-VolumeDependencyTests-852636625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e0d9936a-6e04-4875-8a2a-e000d8a83a32 tempest-VolumeDependencyTests-852636625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:51:59 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e0d9936a-6e04-4875-8a2a-e000d8a83a32 tempest-VolumeDependencyTests-852636625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:51:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e0d9936a-6e04-4875-8a2a-e000d8a83a32 tempest-VolumeDependencyTests-852636625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:51:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e0d9936a-6e04-4875-8a2a-e000d8a83a32 tempest-VolumeDependencyTests-852636625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-dc048513-b3f8-494b-ac4e-991d9e1395b8 tempest-VolumeImageDependencyTests-1040721897 None] Lock "cinder-b8a86786-6173-4ad9-ac26-e16ed5f351fa-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:59 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:51:59 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:51:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-dc048513-b3f8-494b-ac4e-991d9e1395b8 tempest-VolumeImageDependencyTests-1040721897 None] Acquiring lock "cinder-quobyte-b8a86786-6173-4ad9-ac26-e16ed5f351fa" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:51:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-dc048513-b3f8-494b-ac4e-991d9e1395b8 tempest-VolumeImageDependencyTests-1040721897 None] Lock "cinder-quobyte-b8a86786-6173-4ad9-ac26-e16ed5f351fa" acquired by "delete_volume" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:51:59 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[650787f4-e46c-44d4-8bd6-c0eac106cf51]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:51:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dc048513-b3f8-494b-ac4e-991d9e1395b8 tempest-VolumeImageDependencyTests-1040721897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b8a86786-6173-4ad9-ac26-e16ed5f351fa {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:51:59 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b8a86786-6173-4ad9-ac26-e16ed5f351fa Sep 05 11:51:59 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:00 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e0d9936a-6e04-4875-8a2a-e000d8a83a32 tempest-VolumeDependencyTests-852636625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.385s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:00 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-e0d9936a-6e04-4875-8a2a-e000d8a83a32 tempest-VolumeDependencyTests-852636625 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:52:00 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e0d9936a-6e04-4875-8a2a-e000d8a83a32 tempest-VolumeDependencyTests-852636625 None] Deleted volume successfully. Sep 05 11:52:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e0d9936a-6e04-4875-8a2a-e000d8a83a32 tempest-VolumeDependencyTests-852636625 None] Lock "cinder-1a5176d0-629b-4656-8eab-8ce710fec0f6-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:00 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dc048513-b3f8-494b-ac4e-991d9e1395b8 tempest-VolumeImageDependencyTests-1040721897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b8a86786-6173-4ad9-ac26-e16ed5f351fa" returned: 0 in 0.453s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dc048513-b3f8-494b-ac4e-991d9e1395b8 tempest-VolumeImageDependencyTests-1040721897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b8a86786-6173-4ad9-ac26-e16ed5f351fa {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:00 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b8a86786-6173-4ad9-ac26-e16ed5f351fa Sep 05 11:52:00 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:00 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dc048513-b3f8-494b-ac4e-991d9e1395b8 tempest-VolumeImageDependencyTests-1040721897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b8a86786-6173-4ad9-ac26-e16ed5f351fa" returned: 0 in 0.309s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-dc048513-b3f8-494b-ac4e-991d9e1395b8 tempest-VolumeImageDependencyTests-1040721897 None] Lock "cinder-quobyte-b8a86786-6173-4ad9-ac26-e16ed5f351fa" released by "delete_volume" :: held 0.812s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:00 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-dc048513-b3f8-494b-ac4e-991d9e1395b8 tempest-VolumeImageDependencyTests-1040721897 None] Created reservations ['3f1b6f41-6638-4e3b-9476-e1cbb264bc44', '6e35b9f8-f0d1-48b1-8aef-d8131759499b', '35fe9759-b0fc-4ac5-ae61-1ba01db36b24', 'a5678915-c9eb-476e-a573-01fa2fa41620'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:52:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-dc048513-b3f8-494b-ac4e-991d9e1395b8 tempest-VolumeImageDependencyTests-1040721897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-dc048513-b3f8-494b-ac4e-991d9e1395b8 tempest-VolumeImageDependencyTests-1040721897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-dc048513-b3f8-494b-ac4e-991d9e1395b8 tempest-VolumeImageDependencyTests-1040721897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-dc048513-b3f8-494b-ac4e-991d9e1395b8 tempest-VolumeImageDependencyTests-1040721897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-dc048513-b3f8-494b-ac4e-991d9e1395b8 tempest-VolumeImageDependencyTests-1040721897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dc048513-b3f8-494b-ac4e-991d9e1395b8 tempest-VolumeImageDependencyTests-1040721897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:00 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:52:00 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-09be43c2-95cc-4a44-839d-942baba8d45e tempest-SnapshotDependencyTests-1364943872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-09be43c2-95cc-4a44-839d-942baba8d45e tempest-SnapshotDependencyTests-1364943872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:01 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-09be43c2-95cc-4a44-839d-942baba8d45e tempest-SnapshotDependencyTests-1364943872 None] Creating offline snapshot ba2d4928-0f54-4725-bc76-2780fd3d79af of volume 83ef4a72-29f0-42ae-99be-9b168541d15a {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:52:01 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[3086d24f-65a9-448d-a307-b9a70868a95d]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-09be43c2-95cc-4a44-839d-942baba8d45e tempest-SnapshotDependencyTests-1364943872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:01 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a Sep 05 11:52:01 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:01 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dc048513-b3f8-494b-ac4e-991d9e1395b8 tempest-VolumeImageDependencyTests-1040721897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.409s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:01 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-dc048513-b3f8-494b-ac4e-991d9e1395b8 tempest-VolumeImageDependencyTests-1040721897 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:52:01 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-dc048513-b3f8-494b-ac4e-991d9e1395b8 tempest-VolumeImageDependencyTests-1040721897 None] Deleted volume successfully. Sep 05 11:52:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-dc048513-b3f8-494b-ac4e-991d9e1395b8 tempest-VolumeImageDependencyTests-1040721897 None] Lock "cinder-b8a86786-6173-4ad9-ac26-e16ed5f351fa-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:01 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-09be43c2-95cc-4a44-839d-942baba8d45e tempest-SnapshotDependencyTests-1364943872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a" returned: 0 in 0.489s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-09be43c2-95cc-4a44-839d-942baba8d45e tempest-SnapshotDependencyTests-1364943872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a.ba2d4928-0f54-4725-bc76-2780fd3d79af 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:01 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a.ba2d4928-0f54-4725-bc76-2780fd3d79af 1G Sep 05 11:52:01 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:02 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-09be43c2-95cc-4a44-839d-942baba8d45e tempest-SnapshotDependencyTests-1364943872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a.ba2d4928-0f54-4725-bc76-2780fd3d79af 1G" returned: 0 in 0.659s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-09be43c2-95cc-4a44-839d-942baba8d45e tempest-SnapshotDependencyTests-1364943872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83ef4a72-29f0-42ae-99be-9b168541d15a -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a.ba2d4928-0f54-4725-bc76-2780fd3d79af {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:02 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83ef4a72-29f0-42ae-99be-9b168541d15a -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a.ba2d4928-0f54-4725-bc76-2780fd3d79af Sep 05 11:52:02 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:02 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-09be43c2-95cc-4a44-839d-942baba8d45e tempest-SnapshotDependencyTests-1364943872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83ef4a72-29f0-42ae-99be-9b168541d15a -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a.ba2d4928-0f54-4725-bc76-2780fd3d79af" returned: 0 in 0.381s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:02 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-09be43c2-95cc-4a44-839d-942baba8d45e tempest-SnapshotDependencyTests-1364943872 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a.ba2d4928-0f54-4725-bc76-2780fd3d79af is being set with open permissions: ugo+rw Sep 05 11:52:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-09be43c2-95cc-4a44-839d-942baba8d45e tempest-SnapshotDependencyTests-1364943872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a.ba2d4928-0f54-4725-bc76-2780fd3d79af {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:02 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a.ba2d4928-0f54-4725-bc76-2780fd3d79af Sep 05 11:52:02 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:02 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-09be43c2-95cc-4a44-839d-942baba8d45e tempest-SnapshotDependencyTests-1364943872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a.ba2d4928-0f54-4725-bc76-2780fd3d79af" returned: 0 in 0.311s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-09be43c2-95cc-4a44-839d-942baba8d45e tempest-SnapshotDependencyTests-1364943872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:02 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a.info Sep 05 11:52:02 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:03 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-09be43c2-95cc-4a44-839d-942baba8d45e tempest-SnapshotDependencyTests-1364943872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a.info" returned: 0 in 0.285s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:03 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-09be43c2-95cc-4a44-839d-942baba8d45e tempest-SnapshotDependencyTests-1364943872 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a.info is being set with open permissions: ugo+rw Sep 05 11:52:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-09be43c2-95cc-4a44-839d-942baba8d45e tempest-SnapshotDependencyTests-1364943872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:03 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a.info Sep 05 11:52:03 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:03 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-09be43c2-95cc-4a44-839d-942baba8d45e tempest-SnapshotDependencyTests-1364943872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a.info" returned: 0 in 0.254s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-09be43c2-95cc-4a44-839d-942baba8d45e tempest-SnapshotDependencyTests-1364943872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.507s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:03 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-09be43c2-95cc-4a44-839d-942baba8d45e tempest-SnapshotDependencyTests-1364943872 None] Create snapshot completed successfully Sep 05 11:52:04 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:52:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] Flow 'volume_create_manager' (cb355d5c-a573-4b18-9666-92d205908820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:52:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb9359b4-544e-4b46-bb21-48bf49be89e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb9359b4-544e-4b46-bb21-48bf49be89e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc687b1-751c-4f61-a67f-82f96087bbba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951f19c340d942708c9372b47bb08321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:52:04Z,use_quota=True,user_id='714296ca2a8147e7b7bc591a411afc96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e81c786b-ffeb-4495-a970-615a99060424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e81c786b-ffeb-4495-a970-615a99060424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d5c761-e5c2-4cbd-a0e1-d29650006150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d5c761-e5c2-4cbd-a0e1-d29650006150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecc687b1-751c-4f61-a67f-82f96087bbba', 'volume_name': 'volume-ecc687b1-751c-4f61-a67f-82f96087bbba', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90d87335-4042-400d-8197-46f55f520ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90d87335-4042-400d-8197-46f55f520ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c10f6e-1256-4752-99c2-524653e3f793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:04 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] Volume ecc687b1-751c-4f61-a67f-82f96087bbba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecc687b1-751c-4f61-a67f-82f96087bbba', 'volume_size': 1} Sep 05 11:52:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc687b1-751c-4f61-a67f-82f96087bbba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951f19c340d942708c9372b47bb08321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:52:04Z,use_quota=True,user_id='714296ca2a8147e7b7bc591a411afc96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:52:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] Creating volume ecc687b1-751c-4f61-a67f-82f96087bbba {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:52:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:52:04 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:52:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ecc687b1-751c-4f61-a67f-82f96087bbba 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:04 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ecc687b1-751c-4f61-a67f-82f96087bbba 1073741824 Sep 05 11:52:04 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:04 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ecc687b1-751c-4f61-a67f-82f96087bbba 1073741824" returned: 0 in 0.686s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:04 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:52:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ecc687b1-751c-4f61-a67f-82f96087bbba {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:04 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ecc687b1-751c-4f61-a67f-82f96087bbba Sep 05 11:52:04 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Flow 'volume_create_manager' (3d9bf772-f616-4021-8ea6-606c4ac01608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00fb8b7d-e75f-4d31-b91a-5e029983f119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00fb8b7d-e75f-4d31-b91a-5e029983f119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b35f4b5-0948-41c0-bd6e-6fa22c8fd583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fe76998b69442d7b93f066cdcd76c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ba2d4928-0f54-4725-bc76-2780fd3d79af,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:52:05Z,use_quota=True,user_id='f1895e35113245d59d3fc50f3a686e64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (558b0fa9-e3e1-47bd-8d6c-aa88e1c86d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (558b0fa9-e3e1-47bd-8d6c-aa88e1c86d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8952cfc6-2b73-4655-959d-eda966bbbd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8952cfc6-2b73-4655-959d-eda966bbbd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9b35f4b5-0948-41c0-bd6e-6fa22c8fd583', 'volume_name': 'volume-9b35f4b5-0948-41c0-bd6e-6fa22c8fd583', 'volume_size': 1, 'snapshot_id': 'ba2d4928-0f54-4725-bc76-2780fd3d79af'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40ab0fcc-e73a-4e66-9adc-991f11042c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40ab0fcc-e73a-4e66-9adc-991f11042c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d383ec4b-4948-4706-b3f7-c966821e5ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:05 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Volume 9b35f4b5-0948-41c0-bd6e-6fa22c8fd583: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9b35f4b5-0948-41c0-bd6e-6fa22c8fd583', 'volume_size': 1, 'snapshot_id': 'ba2d4928-0f54-4725-bc76-2780fd3d79af'} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:05 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ecc687b1-751c-4f61-a67f-82f96087bbba" returned: 0 in 0.366s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.220s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Acquiring lock "cinder-quobyte-ba2d4928-0f54-4725-bc76-2780fd3d79af-9b35f4b5-0948-41c0-bd6e-6fa22c8fd583" by "_create_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c10f6e-1256-4752-99c2-524653e3f793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecc687b1-751c-4f61-a67f-82f96087bbba', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0602ef-812b-443e-9236-531a50e4cf09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Lock "cinder-quobyte-ba2d4928-0f54-4725-bc76-2780fd3d79af-9b35f4b5-0948-41c0-bd6e-6fa22c8fd583" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Creating volume 9b35f4b5-0948-41c0-bd6e-6fa22c8fd583 from snapshot ba2d4928-0f54-4725-bc76-2780fd3d79af {{(pid=87517) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Acquiring lock "cinder-quobyte-9b35f4b5-0948-41c0-bd6e-6fa22c8fd583" by "_copy_volume_from_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:05 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] Volume volume-ecc687b1-751c-4f61-a67f-82f96087bbba (ecc687b1-751c-4f61-a67f-82f96087bbba): created successfully Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0602ef-812b-443e-9236-531a50e4cf09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] Flow 'volume_create_manager' (cb355d5c-a573-4b18-9666-92d205908820) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Lock "cinder-quobyte-9b35f4b5-0948-41c0-bd6e-6fa22c8fd583" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] snapshot: ba2d4928-0f54-4725-bc76-2780fd3d79af, volume: 9b35f4b5-0948-41c0-bd6e-6fa22c8fd583, {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:05 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f4a09f8b-b43e-4fad-b794-d508ccfa42f4 tempest-CinderUnicodeTest-1820328059 None] Created volume successfully. Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b59ea94-155c-4dd2-92e3-c34f75e6474c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a.ba2d4928-0f54-4725-bc76-2780fd3d79af {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:05 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a.ba2d4928-0f54-4725-bc76-2780fd3d79af Sep 05 11:52:05 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:05 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a.ba2d4928-0f54-4725-bc76-2780fd3d79af" returned: 0 in 0.436s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83ef4a72-29f0-42ae-99be-9b168541d15a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b0a438-86bc-4f8b-a5b0-000b63a8bcbf]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:06 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a Sep 05 11:52:06 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:06 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a" returned: 0 in 0.432s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 05 11:52:06 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Creating direct copy from snapshot {{(pid=87517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 05 11:52:06 devstack cinder-volume[87517]: DEBUG cinder.utils [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Path /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9b35f4b5-0948-41c0-bd6e-6fa22c8fd583 not found in is_blk_device check {{(pid=87517) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 11:52:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9b35f4b5-0948-41c0-bd6e-6fa22c8fd583 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:06 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9b35f4b5-0948-41c0-bd6e-6fa22c8fd583 Sep 05 11:52:06 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:06 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:52:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] Flow 'volume_create_manager' (9930222d-174b-4392-855f-2a7a4300f6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:52:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5387342a-f232-47da-b83d-22cefa7acce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5387342a-f232-47da-b83d-22cefa7acce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:52:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1551850308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b587e38-028f-4436-99f9-a5f20276b7b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951f19c340d942708c9372b47bb08321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:52:07Z,use_quota=True,user_id='714296ca2a8147e7b7bc591a411afc96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e82d0da-06e9-48fe-bcdc-6e5883f4aa2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e82d0da-06e9-48fe-bcdc-6e5883f4aa2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54667396-5445-426b-93e4-93c16b09e014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54667396-5445-426b-93e4-93c16b09e014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b587e38-028f-4436-99f9-a5f20276b7b9', 'volume_name': 'volume-3b587e38-028f-4436-99f9-a5f20276b7b9', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5906e2-3f71-41f4-a62f-ab9b5127830c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5906e2-3f71-41f4-a62f-ab9b5127830c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:06 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8024bad8-8891-4982-be4e-b645911e8b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:06 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] Volume 3b587e38-028f-4436-99f9-a5f20276b7b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b587e38-028f-4436-99f9-a5f20276b7b9', 'volume_size': 1} Sep 05 11:52:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:12 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9b35f4b5-0948-41c0-bd6e-6fa22c8fd583" returned: 0 in 5.724s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:12 devstack cinder-volume[87517]: DEBUG cinder.image.image_utils [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Image conversion details: src /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9b35f4b5-0948-41c0-bd6e-6fa22c8fd583 {{(pid=87517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 11:52:12 devstack cinder-volume[87517]: INFO cinder.image.image_utils [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Converted 1024.00 MB image at 178.83 MB/s Sep 05 11:52:12 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9b35f4b5-0948-41c0-bd6e-6fa22c8fd583 is being set with open permissions: ugo+rw Sep 05 11:52:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9b35f4b5-0948-41c0-bd6e-6fa22c8fd583 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:12 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9b35f4b5-0948-41c0-bd6e-6fa22c8fd583 Sep 05 11:52:12 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:12 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9b35f4b5-0948-41c0-bd6e-6fa22c8fd583" returned: 0 in 0.274s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Lock "cinder-quobyte-9b35f4b5-0948-41c0-bd6e-6fa22c8fd583" released by "_copy_volume_from_snapshot" :: held 6.974s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Lock "cinder-quobyte-ba2d4928-0f54-4725-bc76-2780fd3d79af-9b35f4b5-0948-41c0-bd6e-6fa22c8fd583" released by "_create_volume_from_snapshot" :: held 7.064s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.105s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.468s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:52:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1551850308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b587e38-028f-4436-99f9-a5f20276b7b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951f19c340d942708c9372b47bb08321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:52:07Z,use_quota=True,user_id='714296ca2a8147e7b7bc591a411afc96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:52:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] Creating volume 3b587e38-028f-4436-99f9-a5f20276b7b9 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:52:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:52:12 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:52:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:12 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9 1073741824 Sep 05 11:52:12 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d383ec4b-4948-4706-b3f7-c966821e5ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b35f4b5-0948-41c0-bd6e-6fa22c8fd583', 'volume_size': 1, 'snapshot_id': 'ba2d4928-0f54-4725-bc76-2780fd3d79af'}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1710e8f1-18a1-4e78-8a53-9cf42685d02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:12 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Volume volume-9b35f4b5-0948-41c0-bd6e-6fa22c8fd583 (9b35f4b5-0948-41c0-bd6e-6fa22c8fd583): created successfully Sep 05 11:52:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1710e8f1-18a1-4e78-8a53-9cf42685d02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Flow 'volume_create_manager' (3d9bf772-f616-4021-8ea6-606c4ac01608) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:52:12 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a90acf53-c4a2-43bb-9da9-d44b9b726ad6 tempest-SnapshotDependencyTests-1364943872 None] Created volume successfully. Sep 05 11:52:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-97eeaf8e-374e-4771-909a-707d535418b7 tempest-SnapshotDependencyTests-1364943872 None] Acquiring lock "cinder-ba2d4928-0f54-4725-bc76-2780fd3d79af-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-97eeaf8e-374e-4771-909a-707d535418b7 tempest-SnapshotDependencyTests-1364943872 None] Lock "cinder-ba2d4928-0f54-4725-bc76-2780fd3d79af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-97eeaf8e-374e-4771-909a-707d535418b7 tempest-SnapshotDependencyTests-1364943872 None] Acquiring lock "cinder-quobyte-83ef4a72-29f0-42ae-99be-9b168541d15a" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-97eeaf8e-374e-4771-909a-707d535418b7 tempest-SnapshotDependencyTests-1364943872 None] Lock "cinder-quobyte-83ef4a72-29f0-42ae-99be-9b168541d15a" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-97eeaf8e-374e-4771-909a-707d535418b7 tempest-SnapshotDependencyTests-1364943872 None] Acquiring lock "cinder-quobyte-ba2d4928-0f54-4725-bc76-2780fd3d79af" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:12 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-97eeaf8e-374e-4771-909a-707d535418b7 tempest-SnapshotDependencyTests-1364943872 None] Lock "cinder-quobyte-ba2d4928-0f54-4725-bc76-2780fd3d79af" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-97eeaf8e-374e-4771-909a-707d535418b7 tempest-SnapshotDependencyTests-1364943872 None] Deleting offline snapshot ba2d4928-0f54-4725-bc76-2780fd3d79af of volume 83ef4a72-29f0-42ae-99be-9b168541d15a {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:52:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-97eeaf8e-374e-4771-909a-707d535418b7 tempest-SnapshotDependencyTests-1364943872 None] snapshot_file for this snap is: volume-83ef4a72-29f0-42ae-99be-9b168541d15a.ba2d4928-0f54-4725-bc76-2780fd3d79af {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:52:12 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5600c642-78af-4c85-8faa-257312cdbb35]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-97eeaf8e-374e-4771-909a-707d535418b7 tempest-SnapshotDependencyTests-1364943872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a.ba2d4928-0f54-4725-bc76-2780fd3d79af {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:13 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9 1073741824" returned: 0 in 0.593s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:13 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9 Sep 05 11:52:13 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:13 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a.ba2d4928-0f54-4725-bc76-2780fd3d79af Sep 05 11:52:13 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] Flow 'volume_create_manager' (ec5a1ce2-777c-4bd0-8a63-61778d249fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e71b5ef1-3f0d-4eb5-8869-bf552dd7d01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e71b5ef1-3f0d-4eb5-8869-bf552dd7d01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-962446977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23bd6e26-7084-4c63-86db-2fc3aa714c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d60ba3b97dd749afb0b1b78f89c6c447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:52:13Z,use_quota=True,user_id='21f0c1b339b24b9991544f21176ed9f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (812d705a-4796-4b3f-98d3-0130fc170fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (812d705a-4796-4b3f-98d3-0130fc170fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0be34036-3aa4-42c8-940f-0b96fc559051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0be34036-3aa4-42c8-940f-0b96fc559051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23bd6e26-7084-4c63-86db-2fc3aa714c23', 'volume_name': 'volume-23bd6e26-7084-4c63-86db-2fc3aa714c23', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a654ab5-ee6c-4248-beb6-e94e98ff9e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a654ab5-ee6c-4248-beb6-e94e98ff9e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3556b0c-744c-4081-9e54-d891b0492090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:13 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] Volume 23bd6e26-7084-4c63-86db-2fc3aa714c23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23bd6e26-7084-4c63-86db-2fc3aa714c23', 'volume_size': 1} Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:13 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9" returned: 0 in 0.272s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-962446977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23bd6e26-7084-4c63-86db-2fc3aa714c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d60ba3b97dd749afb0b1b78f89c6c447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:52:13Z,use_quota=True,user_id='21f0c1b339b24b9991544f21176ed9f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] Creating volume 23bd6e26-7084-4c63-86db-2fc3aa714c23 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:52:13 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-23bd6e26-7084-4c63-86db-2fc3aa714c23 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8024bad8-8891-4982-be4e-b645911e8b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b587e38-028f-4436-99f9-a5f20276b7b9', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999b9239-f256-47d4-a206-78f267b87fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:13 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-23bd6e26-7084-4c63-86db-2fc3aa714c23 1073741824 Sep 05 11:52:13 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:13 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] Volume volume-3b587e38-028f-4436-99f9-a5f20276b7b9 (3b587e38-028f-4436-99f9-a5f20276b7b9): created successfully Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999b9239-f256-47d4-a206-78f267b87fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] Flow 'volume_create_manager' (9930222d-174b-4392-855f-2a7a4300f6cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:52:13 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-7e813b4d-f3de-455c-8ee2-c85bab684416 tempest-CinderUnicodeTest-1820328059 None] Created volume successfully. Sep 05 11:52:13 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-97eeaf8e-374e-4771-909a-707d535418b7 tempest-SnapshotDependencyTests-1364943872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a.ba2d4928-0f54-4725-bc76-2780fd3d79af" returned: 0 in 0.526s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-97eeaf8e-374e-4771-909a-707d535418b7 tempest-SnapshotDependencyTests-1364943872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83ef4a72-29f0-42ae-99be-9b168541d15a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9f726d-3d45-4a1f-9656-0ac49d5eadc2]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-97eeaf8e-374e-4771-909a-707d535418b7 tempest-SnapshotDependencyTests-1364943872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:13 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a Sep 05 11:52:13 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:13 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-23bd6e26-7084-4c63-86db-2fc3aa714c23 1073741824" returned: 0 in 0.537s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-23bd6e26-7084-4c63-86db-2fc3aa714c23 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8bd0914c-c131-403f-b83b-9ec7c013e042 tempest-CinderUnicodeTest-1820328059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:14 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-23bd6e26-7084-4c63-86db-2fc3aa714c23 Sep 05 11:52:14 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:14 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] Flow 'volume_create_manager' (956d41ce-a07b-4faf-ad9b-f6370069c046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6a392e-a574-435d-9cda-637e5996ea6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-97eeaf8e-374e-4771-909a-707d535418b7 tempest-SnapshotDependencyTests-1364943872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a" returned: 0 in 0.683s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-97eeaf8e-374e-4771-909a-707d535418b7 tempest-SnapshotDependencyTests-1364943872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a.ba2d4928-0f54-4725-bc76-2780fd3d79af {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:14 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-23bd6e26-7084-4c63-86db-2fc3aa714c23" returned: 0 in 0.293s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8bd0914c-c131-403f-b83b-9ec7c013e042 tempest-CinderUnicodeTest-1820328059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.267s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:14 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a.ba2d4928-0f54-4725-bc76-2780fd3d79af Sep 05 11:52:14 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6a392e-a574-435d-9cda-637e5996ea6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1821943916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a59970c-869d-45e8-9439-20d75a95b649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19721c63425b45ed9804232ddcf1e000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:52:14Z,use_quota=True,user_id='335cdccede6c4f1eb437e1702bf54a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11977aa3-21c3-457e-a915-92db2fea0ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11977aa3-21c3-457e-a915-92db2fea0ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ade2da5-4cfb-4df1-890d-f19b2fb94f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ade2da5-4cfb-4df1-890d-f19b2fb94f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a59970c-869d-45e8-9439-20d75a95b649', 'volume_name': 'volume-7a59970c-869d-45e8-9439-20d75a95b649', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f9e1d0-aee6-4011-ab7d-e4494dac6557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f9e1d0-aee6-4011-ab7d-e4494dac6557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b46fcde2-42fe-4811-9ece-27fc01ea91bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:14 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] Volume 7a59970c-869d-45e8-9439-20d75a95b649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a59970c-869d-45e8-9439-20d75a95b649', 'volume_size': 1} Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-8bd0914c-c131-403f-b83b-9ec7c013e042 tempest-CinderUnicodeTest-1820328059 None] Creating offline snapshot 8cf81126-fa5c-4f13-8e93-a77302d056ef of volume 3b587e38-028f-4436-99f9-a5f20276b7b9 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3556b0c-744c-4081-9e54-d891b0492090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23bd6e26-7084-4c63-86db-2fc3aa714c23', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc45c95f-0db5-41fc-9fb1-9815aad4ae29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ca1340-9706-476f-b392-627972d487c6]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8bd0914c-c131-403f-b83b-9ec7c013e042 tempest-CinderUnicodeTest-1820328059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:14 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] Volume volume-23bd6e26-7084-4c63-86db-2fc3aa714c23 (23bd6e26-7084-4c63-86db-2fc3aa714c23): created successfully Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc45c95f-0db5-41fc-9fb1-9815aad4ae29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] Flow 'volume_create_manager' (ec5a1ce2-777c-4bd0-8a63-61778d249fc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:52:14 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-18d6bee4-ee6e-4d67-bab7-de644a53b27c tempest-ProjectReaderTests-1585707484 None] Created volume successfully. Sep 05 11:52:14 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9 Sep 05 11:52:14 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:14 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-97eeaf8e-374e-4771-909a-707d535418b7 tempest-SnapshotDependencyTests-1364943872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a.ba2d4928-0f54-4725-bc76-2780fd3d79af" returned: 0 in 0.329s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-97eeaf8e-374e-4771-909a-707d535418b7 tempest-SnapshotDependencyTests-1364943872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a.ba2d4928-0f54-4725-bc76-2780fd3d79af {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:14 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a.ba2d4928-0f54-4725-bc76-2780fd3d79af Sep 05 11:52:14 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:14 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8bd0914c-c131-403f-b83b-9ec7c013e042 tempest-CinderUnicodeTest-1820328059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9" returned: 0 in 0.384s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8bd0914c-c131-403f-b83b-9ec7c013e042 tempest-CinderUnicodeTest-1820328059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9.8cf81126-fa5c-4f13-8e93-a77302d056ef 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:14 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9.8cf81126-fa5c-4f13-8e93-a77302d056ef 1G Sep 05 11:52:14 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:14 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-97eeaf8e-374e-4771-909a-707d535418b7 tempest-SnapshotDependencyTests-1364943872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a.ba2d4928-0f54-4725-bc76-2780fd3d79af" returned: 0 in 0.261s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-97eeaf8e-374e-4771-909a-707d535418b7 tempest-SnapshotDependencyTests-1364943872 None] Lock "cinder-quobyte-ba2d4928-0f54-4725-bc76-2780fd3d79af" released by "_delete_snapshot" :: held 1.905s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-97eeaf8e-374e-4771-909a-707d535418b7 tempest-SnapshotDependencyTests-1364943872 None] Lock "cinder-quobyte-83ef4a72-29f0-42ae-99be-9b168541d15a" released by "delete_snapshot" :: held 1.935s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:14 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-97eeaf8e-374e-4771-909a-707d535418b7 tempest-SnapshotDependencyTests-1364943872 None] Created reservations ['58de8f47-9ab0-4d13-ac88-3fa7fb30328a', '57d58814-43e4-4ceb-8952-da1052e782c3', 'a66942dc-c4c0-4218-a9b0-f490484994eb', '0b87159c-b378-4fdc-bd7f-e754173926cb'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:52:15 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-97eeaf8e-374e-4771-909a-707d535418b7 tempest-SnapshotDependencyTests-1364943872 None] Delete snapshot completed successfully. Sep 05 11:52:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-97eeaf8e-374e-4771-909a-707d535418b7 tempest-SnapshotDependencyTests-1364943872 None] Lock "cinder-ba2d4928-0f54-4725-bc76-2780fd3d79af-delete_snapshot" released by "delete_snapshot" :: held 2.121s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-36373754-f138-424c-8752-8448a5879649 tempest-SnapshotDependencyTests-1364943872 None] Acquiring lock "cinder-83ef4a72-29f0-42ae-99be-9b168541d15a-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-36373754-f138-424c-8752-8448a5879649 tempest-SnapshotDependencyTests-1364943872 None] Lock "cinder-83ef4a72-29f0-42ae-99be-9b168541d15a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-36373754-f138-424c-8752-8448a5879649 tempest-SnapshotDependencyTests-1364943872 None] Acquiring lock "cinder-quobyte-83ef4a72-29f0-42ae-99be-9b168541d15a" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-36373754-f138-424c-8752-8448a5879649 tempest-SnapshotDependencyTests-1364943872 None] Lock "cinder-quobyte-83ef4a72-29f0-42ae-99be-9b168541d15a" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:15 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c971e86-7e7e-4f43-8b21-83f810fbd415]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-36373754-f138-424c-8752-8448a5879649 tempest-SnapshotDependencyTests-1364943872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:15 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8bd0914c-c131-403f-b83b-9ec7c013e042 tempest-CinderUnicodeTest-1820328059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9.8cf81126-fa5c-4f13-8e93-a77302d056ef 1G" returned: 0 in 0.480s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8bd0914c-c131-403f-b83b-9ec7c013e042 tempest-CinderUnicodeTest-1820328059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b587e38-028f-4436-99f9-a5f20276b7b9 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9.8cf81126-fa5c-4f13-8e93-a77302d056ef {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:15 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b587e38-028f-4436-99f9-a5f20276b7b9 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9.8cf81126-fa5c-4f13-8e93-a77302d056ef Sep 05 11:52:15 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:15 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a Sep 05 11:52:15 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5cc55ef3-ca07-4dd3-8791-e75691fc15ad tempest-ProjectReaderTests-1585707484 None] Acquiring lock "cinder-23bd6e26-7084-4c63-86db-2fc3aa714c23-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:15 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5cc55ef3-ca07-4dd3-8791-e75691fc15ad tempest-ProjectReaderTests-1585707484 None] Lock "cinder-23bd6e26-7084-4c63-86db-2fc3aa714c23-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8bd0914c-c131-403f-b83b-9ec7c013e042 tempest-CinderUnicodeTest-1820328059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b587e38-028f-4436-99f9-a5f20276b7b9 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9.8cf81126-fa5c-4f13-8e93-a77302d056ef" returned: 0 in 0.312s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:15 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-8bd0914c-c131-403f-b83b-9ec7c013e042 tempest-CinderUnicodeTest-1820328059 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9.8cf81126-fa5c-4f13-8e93-a77302d056ef is being set with open permissions: ugo+rw Sep 05 11:52:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8bd0914c-c131-403f-b83b-9ec7c013e042 tempest-CinderUnicodeTest-1820328059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9.8cf81126-fa5c-4f13-8e93-a77302d056ef {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:15 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9.8cf81126-fa5c-4f13-8e93-a77302d056ef Sep 05 11:52:15 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5cc55ef3-ca07-4dd3-8791-e75691fc15ad tempest-ProjectReaderTests-1585707484 None] Acquiring lock "cinder-quobyte-23bd6e26-7084-4c63-86db-2fc3aa714c23" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5cc55ef3-ca07-4dd3-8791-e75691fc15ad tempest-ProjectReaderTests-1585707484 None] Lock "cinder-quobyte-23bd6e26-7084-4c63-86db-2fc3aa714c23" acquired by "delete_volume" :: waited 0.025s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:15 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:15 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5a9e5c-3454-42a2-9a3b-cd127065dbe2]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5cc55ef3-ca07-4dd3-8791-e75691fc15ad tempest-ProjectReaderTests-1585707484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-23bd6e26-7084-4c63-86db-2fc3aa714c23 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-36373754-f138-424c-8752-8448a5879649 tempest-SnapshotDependencyTests-1364943872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a" returned: 0 in 0.443s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-36373754-f138-424c-8752-8448a5879649 tempest-SnapshotDependencyTests-1364943872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:15 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a Sep 05 11:52:15 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:15 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-23bd6e26-7084-4c63-86db-2fc3aa714c23 Sep 05 11:52:15 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:15 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8bd0914c-c131-403f-b83b-9ec7c013e042 tempest-CinderUnicodeTest-1820328059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9.8cf81126-fa5c-4f13-8e93-a77302d056ef" returned: 0 in 0.273s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8bd0914c-c131-403f-b83b-9ec7c013e042 tempest-CinderUnicodeTest-1820328059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:15 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9.info Sep 05 11:52:15 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:15 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-36373754-f138-424c-8752-8448a5879649 tempest-SnapshotDependencyTests-1364943872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-83ef4a72-29f0-42ae-99be-9b168541d15a" returned: 0 in 0.262s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-36373754-f138-424c-8752-8448a5879649 tempest-SnapshotDependencyTests-1364943872 None] Lock "cinder-quobyte-83ef4a72-29f0-42ae-99be-9b168541d15a" released by "delete_volume" :: held 0.780s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-36373754-f138-424c-8752-8448a5879649 tempest-SnapshotDependencyTests-1364943872 None] Created reservations ['99a9e17b-a722-4628-bcfb-02b36513f141', 'dde394f3-81f5-4abe-b5b9-e1818d7462e6', '01062a97-f61e-41b3-8c80-0e97ab0e7a2b', 'c1c3d6c6-94d1-4356-a425-79cce93d7cca'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:52:16 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5cc55ef3-ca07-4dd3-8791-e75691fc15ad tempest-ProjectReaderTests-1585707484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-23bd6e26-7084-4c63-86db-2fc3aa714c23" returned: 0 in 0.400s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5cc55ef3-ca07-4dd3-8791-e75691fc15ad tempest-ProjectReaderTests-1585707484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-23bd6e26-7084-4c63-86db-2fc3aa714c23 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:16 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-23bd6e26-7084-4c63-86db-2fc3aa714c23 Sep 05 11:52:16 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-36373754-f138-424c-8752-8448a5879649 tempest-SnapshotDependencyTests-1364943872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-36373754-f138-424c-8752-8448a5879649 tempest-SnapshotDependencyTests-1364943872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-36373754-f138-424c-8752-8448a5879649 tempest-SnapshotDependencyTests-1364943872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-36373754-f138-424c-8752-8448a5879649 tempest-SnapshotDependencyTests-1364943872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-36373754-f138-424c-8752-8448a5879649 tempest-SnapshotDependencyTests-1364943872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-36373754-f138-424c-8752-8448a5879649 tempest-SnapshotDependencyTests-1364943872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:16 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8bd0914c-c131-403f-b83b-9ec7c013e042 tempest-CinderUnicodeTest-1820328059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9.info" returned: 0 in 0.286s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:16 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-8bd0914c-c131-403f-b83b-9ec7c013e042 tempest-CinderUnicodeTest-1820328059 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9.info is being set with open permissions: ugo+rw Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8bd0914c-c131-403f-b83b-9ec7c013e042 tempest-CinderUnicodeTest-1820328059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:16 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:52:16 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:16 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9.info Sep 05 11:52:16 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5a457a9f-0f3f-464b-a62a-f04c52e26f86 tempest-SnapshotDependencyTests-1364943872 None] Acquiring lock "cinder-9b35f4b5-0948-41c0-bd6e-6fa22c8fd583-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5a457a9f-0f3f-464b-a62a-f04c52e26f86 tempest-SnapshotDependencyTests-1364943872 None] Lock "cinder-9b35f4b5-0948-41c0-bd6e-6fa22c8fd583-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:16 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5cc55ef3-ca07-4dd3-8791-e75691fc15ad tempest-ProjectReaderTests-1585707484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-23bd6e26-7084-4c63-86db-2fc3aa714c23" returned: 0 in 0.310s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5cc55ef3-ca07-4dd3-8791-e75691fc15ad tempest-ProjectReaderTests-1585707484 None] Lock "cinder-quobyte-23bd6e26-7084-4c63-86db-2fc3aa714c23" released by "delete_volume" :: held 0.765s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:16 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-36373754-f138-424c-8752-8448a5879649 tempest-SnapshotDependencyTests-1364943872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.308s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-36373754-f138-424c-8752-8448a5879649 tempest-SnapshotDependencyTests-1364943872 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5a457a9f-0f3f-464b-a62a-f04c52e26f86 tempest-SnapshotDependencyTests-1364943872 None] Acquiring lock "cinder-quobyte-9b35f4b5-0948-41c0-bd6e-6fa22c8fd583" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:16 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-36373754-f138-424c-8752-8448a5879649 tempest-SnapshotDependencyTests-1364943872 None] Deleted volume successfully. Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5a457a9f-0f3f-464b-a62a-f04c52e26f86 tempest-SnapshotDependencyTests-1364943872 None] Lock "cinder-quobyte-9b35f4b5-0948-41c0-bd6e-6fa22c8fd583" acquired by "delete_volume" :: waited 0.024s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:16 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8bd0914c-c131-403f-b83b-9ec7c013e042 tempest-CinderUnicodeTest-1820328059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9.info" returned: 0 in 0.334s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8bd0914c-c131-403f-b83b-9ec7c013e042 tempest-CinderUnicodeTest-1820328059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.207s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fc8064-582b-434a-8117-177f73bd0d9e]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-36373754-f138-424c-8752-8448a5879649 tempest-SnapshotDependencyTests-1364943872 None] Lock "cinder-83ef4a72-29f0-42ae-99be-9b168541d15a-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.166s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1821943916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a59970c-869d-45e8-9439-20d75a95b649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19721c63425b45ed9804232ddcf1e000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:52:14Z,use_quota=True,user_id='335cdccede6c4f1eb437e1702bf54a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] Creating volume 7a59970c-869d-45e8-9439-20d75a95b649 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:52:16 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5a457a9f-0f3f-464b-a62a-f04c52e26f86 tempest-SnapshotDependencyTests-1364943872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9b35f4b5-0948-41c0-bd6e-6fa22c8fd583 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:16 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649 1073741824 Sep 05 11:52:16 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-5cc55ef3-ca07-4dd3-8791-e75691fc15ad tempest-ProjectReaderTests-1585707484 None] Created reservations ['d20d2903-6a92-42df-a467-063506d77644', 'c2d29223-82dd-43ff-b4c4-5250edc14d5d', '28a84355-5665-4b58-91f0-1745d6216b20', 'aeec9047-633d-4d7b-9011-23660719d6ae'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:52:16 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-8bd0914c-c131-403f-b83b-9ec7c013e042 tempest-CinderUnicodeTest-1820328059 None] Create snapshot completed successfully Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5cc55ef3-ca07-4dd3-8791-e75691fc15ad tempest-ProjectReaderTests-1585707484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5cc55ef3-ca07-4dd3-8791-e75691fc15ad tempest-ProjectReaderTests-1585707484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5cc55ef3-ca07-4dd3-8791-e75691fc15ad tempest-ProjectReaderTests-1585707484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5cc55ef3-ca07-4dd3-8791-e75691fc15ad tempest-ProjectReaderTests-1585707484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5cc55ef3-ca07-4dd3-8791-e75691fc15ad tempest-ProjectReaderTests-1585707484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5cc55ef3-ca07-4dd3-8791-e75691fc15ad tempest-ProjectReaderTests-1585707484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:16 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:52:16 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:16 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9b35f4b5-0948-41c0-bd6e-6fa22c8fd583 Sep 05 11:52:16 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:16 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5cc55ef3-ca07-4dd3-8791-e75691fc15ad tempest-ProjectReaderTests-1585707484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.291s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-5cc55ef3-ca07-4dd3-8791-e75691fc15ad tempest-ProjectReaderTests-1585707484 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:52:16 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-5cc55ef3-ca07-4dd3-8791-e75691fc15ad tempest-ProjectReaderTests-1585707484 None] Deleted volume successfully. Sep 05 11:52:16 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5a457a9f-0f3f-464b-a62a-f04c52e26f86 tempest-SnapshotDependencyTests-1364943872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9b35f4b5-0948-41c0-bd6e-6fa22c8fd583" returned: 0 in 0.441s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5a457a9f-0f3f-464b-a62a-f04c52e26f86 tempest-SnapshotDependencyTests-1364943872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9b35f4b5-0948-41c0-bd6e-6fa22c8fd583 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5cc55ef3-ca07-4dd3-8791-e75691fc15ad tempest-ProjectReaderTests-1585707484 None] Lock "cinder-23bd6e26-7084-4c63-86db-2fc3aa714c23-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:16 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9b35f4b5-0948-41c0-bd6e-6fa22c8fd583 Sep 05 11:52:16 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:16 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649 1073741824" returned: 0 in 0.501s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:17 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649 Sep 05 11:52:17 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-769136de-e122-4b54-a12b-2c6079184ff7 tempest-CinderUnicodeTest-1820328059 None] Acquiring lock "cinder-8cf81126-fa5c-4f13-8e93-a77302d056ef-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-769136de-e122-4b54-a12b-2c6079184ff7 tempest-CinderUnicodeTest-1820328059 None] Lock "cinder-8cf81126-fa5c-4f13-8e93-a77302d056ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-769136de-e122-4b54-a12b-2c6079184ff7 tempest-CinderUnicodeTest-1820328059 None] Acquiring lock "cinder-quobyte-3b587e38-028f-4436-99f9-a5f20276b7b9" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-769136de-e122-4b54-a12b-2c6079184ff7 tempest-CinderUnicodeTest-1820328059 None] Lock "cinder-quobyte-3b587e38-028f-4436-99f9-a5f20276b7b9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-769136de-e122-4b54-a12b-2c6079184ff7 tempest-CinderUnicodeTest-1820328059 None] Acquiring lock "cinder-quobyte-8cf81126-fa5c-4f13-8e93-a77302d056ef" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-769136de-e122-4b54-a12b-2c6079184ff7 tempest-CinderUnicodeTest-1820328059 None] Lock "cinder-quobyte-8cf81126-fa5c-4f13-8e93-a77302d056ef" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-769136de-e122-4b54-a12b-2c6079184ff7 tempest-CinderUnicodeTest-1820328059 None] Deleting offline snapshot 8cf81126-fa5c-4f13-8e93-a77302d056ef of volume 3b587e38-028f-4436-99f9-a5f20276b7b9 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:52:17 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-769136de-e122-4b54-a12b-2c6079184ff7 tempest-CinderUnicodeTest-1820328059 None] snapshot_file for this snap is: volume-3b587e38-028f-4436-99f9-a5f20276b7b9.8cf81126-fa5c-4f13-8e93-a77302d056ef {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5a457a9f-0f3f-464b-a62a-f04c52e26f86 tempest-SnapshotDependencyTests-1364943872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-9b35f4b5-0948-41c0-bd6e-6fa22c8fd583" returned: 0 in 0.339s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[83384f0a-19ba-48a2-bbab-7641022e6947]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-769136de-e122-4b54-a12b-2c6079184ff7 tempest-CinderUnicodeTest-1820328059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9.8cf81126-fa5c-4f13-8e93-a77302d056ef {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5a457a9f-0f3f-464b-a62a-f04c52e26f86 tempest-SnapshotDependencyTests-1364943872 None] Lock "cinder-quobyte-9b35f4b5-0948-41c0-bd6e-6fa22c8fd583" released by "delete_volume" :: held 0.880s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] Flow 'volume_create_manager' (82e84f9d-6996-4502-9d0e-a2884ba72d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2f84988-92b7-44c6-b4b6-c578b93cc57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2f84988-92b7-44c6-b4b6-c578b93cc57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1449651643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b5ea35a-0638-4e92-ad99-1f30108ea79e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d60ba3b97dd749afb0b1b78f89c6c447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:52:17Z,use_quota=True,user_id='21f0c1b339b24b9991544f21176ed9f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe8049c3-239b-4183-be93-388a2f2faf3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe8049c3-239b-4183-be93-388a2f2faf3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed145090-ce15-45b2-80c8-cf554edf1a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed145090-ce15-45b2-80c8-cf554edf1a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b5ea35a-0638-4e92-ad99-1f30108ea79e', 'volume_name': 'volume-6b5ea35a-0638-4e92-ad99-1f30108ea79e', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:17 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4218789-d55d-4200-8079-974d29da99b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4218789-d55d-4200-8079-974d29da99b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:17 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9.8cf81126-fa5c-4f13-8e93-a77302d056ef Sep 05 11:52:17 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2818c0b6-8922-44e3-9741-6a99a4063830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:17 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] Volume 6b5ea35a-0638-4e92-ad99-1f30108ea79e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b5ea35a-0638-4e92-ad99-1f30108ea79e', 'volume_size': 1} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649" returned: 0 in 0.379s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1449651643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b5ea35a-0638-4e92-ad99-1f30108ea79e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d60ba3b97dd749afb0b1b78f89c6c447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:52:17Z,use_quota=True,user_id='21f0c1b339b24b9991544f21176ed9f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] Creating volume 6b5ea35a-0638-4e92-ad99-1f30108ea79e {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:52:17 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6b5ea35a-0638-4e92-ad99-1f30108ea79e 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b46fcde2-42fe-4811-9ece-27fc01ea91bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a59970c-869d-45e8-9439-20d75a95b649', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:17 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6b5ea35a-0638-4e92-ad99-1f30108ea79e 1073741824 Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2042e3f4-89e0-4c76-af55-737ed516fde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:17 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:17 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] Volume volume-7a59970c-869d-45e8-9439-20d75a95b649 (7a59970c-869d-45e8-9439-20d75a95b649): created successfully Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2042e3f4-89e0-4c76-af55-737ed516fde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] Flow 'volume_create_manager' (956d41ce-a07b-4faf-ad9b-f6370069c046) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:52:17 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e74acbcd-7fe6-4c3e-9b81-7989a6979bae tempest-ProjectReaderTests-1534806197 None] Created volume successfully. Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-5a457a9f-0f3f-464b-a62a-f04c52e26f86 tempest-SnapshotDependencyTests-1364943872 None] Created reservations ['e0ac2a12-d1ff-409c-b4a5-454ddb03203f', 'ab0d11bf-c0c5-4b36-9f1b-aaab83635304', 'f5fbd116-09c0-4d2a-82fe-b3754e80accd', '6caf046f-d04d-409b-8bf7-9d91f2228dd1'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5a457a9f-0f3f-464b-a62a-f04c52e26f86 tempest-SnapshotDependencyTests-1364943872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5a457a9f-0f3f-464b-a62a-f04c52e26f86 tempest-SnapshotDependencyTests-1364943872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5a457a9f-0f3f-464b-a62a-f04c52e26f86 tempest-SnapshotDependencyTests-1364943872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5a457a9f-0f3f-464b-a62a-f04c52e26f86 tempest-SnapshotDependencyTests-1364943872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5a457a9f-0f3f-464b-a62a-f04c52e26f86 tempest-SnapshotDependencyTests-1364943872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5a457a9f-0f3f-464b-a62a-f04c52e26f86 tempest-SnapshotDependencyTests-1364943872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:17 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:52:17 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:17 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-769136de-e122-4b54-a12b-2c6079184ff7 tempest-CinderUnicodeTest-1820328059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9.8cf81126-fa5c-4f13-8e93-a77302d056ef" returned: 0 in 0.457s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-769136de-e122-4b54-a12b-2c6079184ff7 tempest-CinderUnicodeTest-1820328059 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b587e38-028f-4436-99f9-a5f20276b7b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[56863724-0cc8-44d9-a024-8fc8bda27355]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-769136de-e122-4b54-a12b-2c6079184ff7 tempest-CinderUnicodeTest-1820328059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:17 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5a457a9f-0f3f-464b-a62a-f04c52e26f86 tempest-SnapshotDependencyTests-1364943872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.282s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-5a457a9f-0f3f-464b-a62a-f04c52e26f86 tempest-SnapshotDependencyTests-1364943872 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:52:17 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9 Sep 05 11:52:17 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:17 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-5a457a9f-0f3f-464b-a62a-f04c52e26f86 tempest-SnapshotDependencyTests-1364943872 None] Deleted volume successfully. Sep 05 11:52:17 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6b5ea35a-0638-4e92-ad99-1f30108ea79e 1073741824" returned: 0 in 0.455s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5a457a9f-0f3f-464b-a62a-f04c52e26f86 tempest-SnapshotDependencyTests-1364943872 None] Lock "cinder-9b35f4b5-0948-41c0-bd6e-6fa22c8fd583-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6b5ea35a-0638-4e92-ad99-1f30108ea79e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:17 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6b5ea35a-0638-4e92-ad99-1f30108ea79e Sep 05 11:52:17 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:18 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-769136de-e122-4b54-a12b-2c6079184ff7 tempest-CinderUnicodeTest-1820328059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9" returned: 0 in 0.373s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-769136de-e122-4b54-a12b-2c6079184ff7 tempest-CinderUnicodeTest-1820328059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9.8cf81126-fa5c-4f13-8e93-a77302d056ef {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:18 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9.8cf81126-fa5c-4f13-8e93-a77302d056ef Sep 05 11:52:18 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:18 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6b5ea35a-0638-4e92-ad99-1f30108ea79e" returned: 0 in 0.266s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:52:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2818c0b6-8922-44e3-9741-6a99a4063830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b5ea35a-0638-4e92-ad99-1f30108ea79e', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c6a491-99b9-4040-be15-e79a9479d22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:18 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] Volume volume-6b5ea35a-0638-4e92-ad99-1f30108ea79e (6b5ea35a-0638-4e92-ad99-1f30108ea79e): created successfully Sep 05 11:52:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c6a491-99b9-4040-be15-e79a9479d22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] Flow 'volume_create_manager' (82e84f9d-6996-4502-9d0e-a2884ba72d87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:52:18 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-fea2780c-5aac-4cfd-a6d2-7a4e7ef1ca3d tempest-ProjectReaderTests-1585707484 None] Created volume successfully. Sep 05 11:52:18 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-769136de-e122-4b54-a12b-2c6079184ff7 tempest-CinderUnicodeTest-1820328059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9.8cf81126-fa5c-4f13-8e93-a77302d056ef" returned: 0 in 0.367s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-769136de-e122-4b54-a12b-2c6079184ff7 tempest-CinderUnicodeTest-1820328059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9.8cf81126-fa5c-4f13-8e93-a77302d056ef {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:18 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9.8cf81126-fa5c-4f13-8e93-a77302d056ef Sep 05 11:52:18 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-33b2eea7-0883-4224-ad85-321303a4388e tempest-ProjectReaderTests-1534806197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-33b2eea7-0883-4224-ad85-321303a4388e tempest-ProjectReaderTests-1534806197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-33b2eea7-0883-4224-ad85-321303a4388e tempest-ProjectReaderTests-1534806197 None] Creating offline snapshot aa0d7d29-a187-4eef-a39c-1254c2dc9d64 of volume 7a59970c-869d-45e8-9439-20d75a95b649 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:52:18 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcb9ded-0254-4643-a5d3-22974d5479d1]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-33b2eea7-0883-4224-ad85-321303a4388e tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:18 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649 Sep 05 11:52:18 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:18 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-769136de-e122-4b54-a12b-2c6079184ff7 tempest-CinderUnicodeTest-1820328059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9.8cf81126-fa5c-4f13-8e93-a77302d056ef" returned: 0 in 0.286s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-769136de-e122-4b54-a12b-2c6079184ff7 tempest-CinderUnicodeTest-1820328059 None] Lock "cinder-quobyte-8cf81126-fa5c-4f13-8e93-a77302d056ef" released by "_delete_snapshot" :: held 1.618s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-769136de-e122-4b54-a12b-2c6079184ff7 tempest-CinderUnicodeTest-1820328059 None] Lock "cinder-quobyte-3b587e38-028f-4436-99f9-a5f20276b7b9" released by "delete_snapshot" :: held 1.656s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:18 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-769136de-e122-4b54-a12b-2c6079184ff7 tempest-CinderUnicodeTest-1820328059 None] Created reservations ['a1bb17af-a36c-4ac6-8372-2bf9b40a486e', '35d745df-2fe1-4874-bf68-5a44a9053b22', 'a74c01da-0ecd-432e-920e-bad0bbd17f79', 'f98e8217-c4b4-4841-9760-b23303cc0077'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:52:18 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-769136de-e122-4b54-a12b-2c6079184ff7 tempest-CinderUnicodeTest-1820328059 None] Delete snapshot completed successfully. Sep 05 11:52:18 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-769136de-e122-4b54-a12b-2c6079184ff7 tempest-CinderUnicodeTest-1820328059 None] Lock "cinder-8cf81126-fa5c-4f13-8e93-a77302d056ef-delete_snapshot" released by "delete_snapshot" :: held 1.811s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:19 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-33b2eea7-0883-4224-ad85-321303a4388e tempest-ProjectReaderTests-1534806197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649" returned: 0 in 0.398s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-33b2eea7-0883-4224-ad85-321303a4388e tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649.aa0d7d29-a187-4eef-a39c-1254c2dc9d64 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:19 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649.aa0d7d29-a187-4eef-a39c-1254c2dc9d64 1G Sep 05 11:52:19 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-19ed82e0-a18e-4ae7-b497-da9373bbb52b tempest-CinderUnicodeTest-1820328059 None] Acquiring lock "cinder-3b587e38-028f-4436-99f9-a5f20276b7b9-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-611b6868-2fec-4971-90f8-5f88043121f2 tempest-ProjectReaderTests-1585707484 None] Acquiring lock "cinder-6b5ea35a-0638-4e92-ad99-1f30108ea79e-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-19ed82e0-a18e-4ae7-b497-da9373bbb52b tempest-CinderUnicodeTest-1820328059 None] Lock "cinder-3b587e38-028f-4436-99f9-a5f20276b7b9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-611b6868-2fec-4971-90f8-5f88043121f2 tempest-ProjectReaderTests-1585707484 None] Lock "cinder-6b5ea35a-0638-4e92-ad99-1f30108ea79e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-19ed82e0-a18e-4ae7-b497-da9373bbb52b tempest-CinderUnicodeTest-1820328059 None] Acquiring lock "cinder-quobyte-3b587e38-028f-4436-99f9-a5f20276b7b9" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-611b6868-2fec-4971-90f8-5f88043121f2 tempest-ProjectReaderTests-1585707484 None] Acquiring lock "cinder-quobyte-6b5ea35a-0638-4e92-ad99-1f30108ea79e" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-611b6868-2fec-4971-90f8-5f88043121f2 tempest-ProjectReaderTests-1585707484 None] Lock "cinder-quobyte-6b5ea35a-0638-4e92-ad99-1f30108ea79e" acquired by "delete_volume" :: waited 0.025s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:19 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-19ed82e0-a18e-4ae7-b497-da9373bbb52b tempest-CinderUnicodeTest-1820328059 None] Lock "cinder-quobyte-3b587e38-028f-4436-99f9-a5f20276b7b9" acquired by "delete_volume" :: waited 0.054s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:19 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[494c6c5c-3e72-4dbf-8191-c748c88ce1e5]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-611b6868-2fec-4971-90f8-5f88043121f2 tempest-ProjectReaderTests-1585707484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6b5ea35a-0638-4e92-ad99-1f30108ea79e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:19 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b29760d-a0b1-4ee6-a73b-b2f0fa7294cf]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-19ed82e0-a18e-4ae7-b497-da9373bbb52b tempest-CinderUnicodeTest-1820328059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:19 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-33b2eea7-0883-4224-ad85-321303a4388e tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649.aa0d7d29-a187-4eef-a39c-1254c2dc9d64 1G" returned: 0 in 0.522s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-33b2eea7-0883-4224-ad85-321303a4388e tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a59970c-869d-45e8-9439-20d75a95b649 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649.aa0d7d29-a187-4eef-a39c-1254c2dc9d64 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:19 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a59970c-869d-45e8-9439-20d75a95b649 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649.aa0d7d29-a187-4eef-a39c-1254c2dc9d64 Sep 05 11:52:19 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:19 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6b5ea35a-0638-4e92-ad99-1f30108ea79e Sep 05 11:52:19 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:19 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9 Sep 05 11:52:19 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:19 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-33b2eea7-0883-4224-ad85-321303a4388e tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a59970c-869d-45e8-9439-20d75a95b649 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649.aa0d7d29-a187-4eef-a39c-1254c2dc9d64" returned: 0 in 0.354s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:19 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-33b2eea7-0883-4224-ad85-321303a4388e tempest-ProjectReaderTests-1534806197 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649.aa0d7d29-a187-4eef-a39c-1254c2dc9d64 is being set with open permissions: ugo+rw Sep 05 11:52:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-33b2eea7-0883-4224-ad85-321303a4388e tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649.aa0d7d29-a187-4eef-a39c-1254c2dc9d64 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:19 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649.aa0d7d29-a187-4eef-a39c-1254c2dc9d64 Sep 05 11:52:19 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:19 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-611b6868-2fec-4971-90f8-5f88043121f2 tempest-ProjectReaderTests-1585707484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6b5ea35a-0638-4e92-ad99-1f30108ea79e" returned: 0 in 0.454s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-611b6868-2fec-4971-90f8-5f88043121f2 tempest-ProjectReaderTests-1585707484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6b5ea35a-0638-4e92-ad99-1f30108ea79e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:20 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-19ed82e0-a18e-4ae7-b497-da9373bbb52b tempest-CinderUnicodeTest-1820328059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9" returned: 0 in 0.463s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-19ed82e0-a18e-4ae7-b497-da9373bbb52b tempest-CinderUnicodeTest-1820328059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:20 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6b5ea35a-0638-4e92-ad99-1f30108ea79e Sep 05 11:52:20 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:20 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9 Sep 05 11:52:20 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:20 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-33b2eea7-0883-4224-ad85-321303a4388e tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649.aa0d7d29-a187-4eef-a39c-1254c2dc9d64" returned: 0 in 0.279s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-33b2eea7-0883-4224-ad85-321303a4388e tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:20 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649.info Sep 05 11:52:20 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:20 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-19ed82e0-a18e-4ae7-b497-da9373bbb52b tempest-CinderUnicodeTest-1820328059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3b587e38-028f-4436-99f9-a5f20276b7b9" returned: 0 in 0.281s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:20 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-611b6868-2fec-4971-90f8-5f88043121f2 tempest-ProjectReaderTests-1585707484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-6b5ea35a-0638-4e92-ad99-1f30108ea79e" returned: 0 in 0.324s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-19ed82e0-a18e-4ae7-b497-da9373bbb52b tempest-CinderUnicodeTest-1820328059 None] Lock "cinder-quobyte-3b587e38-028f-4436-99f9-a5f20276b7b9" released by "delete_volume" :: held 0.829s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-611b6868-2fec-4971-90f8-5f88043121f2 tempest-ProjectReaderTests-1585707484 None] Lock "cinder-quobyte-6b5ea35a-0638-4e92-ad99-1f30108ea79e" released by "delete_volume" :: held 0.866s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:20 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-19ed82e0-a18e-4ae7-b497-da9373bbb52b tempest-CinderUnicodeTest-1820328059 None] Created reservations ['8142e743-6281-4fba-9a2b-2b99bbe21969', 'cc6e476b-c6d1-448d-a76f-c93341ac561a', 'b36c77b3-1ed9-49e6-a13e-9783d9706d32', 'd2d7f52f-bfb5-44ca-b27b-f944c4f980ba'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:52:20 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-611b6868-2fec-4971-90f8-5f88043121f2 tempest-ProjectReaderTests-1585707484 None] Created reservations ['0267e54b-a153-4d2d-ba08-6d7d70b52f4c', '5f476363-5990-494d-a70f-f01fa9d7d66a', 'fbd4c113-aa4f-4616-ae5a-dee81262a533', 'b0f5f800-aa49-445d-941c-99d10f6e3e0f'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:52:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-19ed82e0-a18e-4ae7-b497-da9373bbb52b tempest-CinderUnicodeTest-1820328059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-19ed82e0-a18e-4ae7-b497-da9373bbb52b tempest-CinderUnicodeTest-1820328059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-19ed82e0-a18e-4ae7-b497-da9373bbb52b tempest-CinderUnicodeTest-1820328059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-19ed82e0-a18e-4ae7-b497-da9373bbb52b tempest-CinderUnicodeTest-1820328059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-19ed82e0-a18e-4ae7-b497-da9373bbb52b tempest-CinderUnicodeTest-1820328059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-19ed82e0-a18e-4ae7-b497-da9373bbb52b tempest-CinderUnicodeTest-1820328059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:20 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:52:20 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:20 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-012ee5c7-a3f2-4088-ac70-e98452fa1d37 tempest-CinderUnicodeTest-1820328059 None] Acquiring lock "cinder-ecc687b1-751c-4f61-a67f-82f96087bbba-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-611b6868-2fec-4971-90f8-5f88043121f2 tempest-ProjectReaderTests-1585707484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-611b6868-2fec-4971-90f8-5f88043121f2 tempest-ProjectReaderTests-1585707484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-611b6868-2fec-4971-90f8-5f88043121f2 tempest-ProjectReaderTests-1585707484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:20 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-611b6868-2fec-4971-90f8-5f88043121f2 tempest-ProjectReaderTests-1585707484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-611b6868-2fec-4971-90f8-5f88043121f2 tempest-ProjectReaderTests-1585707484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-611b6868-2fec-4971-90f8-5f88043121f2 tempest-ProjectReaderTests-1585707484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-33b2eea7-0883-4224-ad85-321303a4388e tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649.info" returned: 0 in 0.405s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:20 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-33b2eea7-0883-4224-ad85-321303a4388e tempest-ProjectReaderTests-1534806197 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649.info is being set with open permissions: ugo+rw Sep 05 11:52:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-33b2eea7-0883-4224-ad85-321303a4388e tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-012ee5c7-a3f2-4088-ac70-e98452fa1d37 tempest-CinderUnicodeTest-1820328059 None] Lock "cinder-ecc687b1-751c-4f61-a67f-82f96087bbba-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:20 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:52:20 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:20 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649.info Sep 05 11:52:20 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-012ee5c7-a3f2-4088-ac70-e98452fa1d37 tempest-CinderUnicodeTest-1820328059 None] Acquiring lock "cinder-quobyte-ecc687b1-751c-4f61-a67f-82f96087bbba" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:20 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-012ee5c7-a3f2-4088-ac70-e98452fa1d37 tempest-CinderUnicodeTest-1820328059 None] Lock "cinder-quobyte-ecc687b1-751c-4f61-a67f-82f96087bbba" acquired by "delete_volume" :: waited 0.046s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:20 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45b6c18-8bcc-48af-9782-cc238f8f9f92]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-012ee5c7-a3f2-4088-ac70-e98452fa1d37 tempest-CinderUnicodeTest-1820328059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ecc687b1-751c-4f61-a67f-82f96087bbba {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:20 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-19ed82e0-a18e-4ae7-b497-da9373bbb52b tempest-CinderUnicodeTest-1820328059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.413s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:20 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-19ed82e0-a18e-4ae7-b497-da9373bbb52b tempest-CinderUnicodeTest-1820328059 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:52:20 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-19ed82e0-a18e-4ae7-b497-da9373bbb52b tempest-CinderUnicodeTest-1820328059 None] Deleted volume successfully. Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-19ed82e0-a18e-4ae7-b497-da9373bbb52b tempest-CinderUnicodeTest-1820328059 None] Lock "cinder-3b587e38-028f-4436-99f9-a5f20276b7b9-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:21 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-33b2eea7-0883-4224-ad85-321303a4388e tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649.info" returned: 0 in 0.388s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-33b2eea7-0883-4224-ad85-321303a4388e tempest-ProjectReaderTests-1534806197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.468s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:21 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-611b6868-2fec-4971-90f8-5f88043121f2 tempest-ProjectReaderTests-1585707484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.453s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-611b6868-2fec-4971-90f8-5f88043121f2 tempest-ProjectReaderTests-1585707484 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:52:21 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ecc687b1-751c-4f61-a67f-82f96087bbba Sep 05 11:52:21 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:21 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-611b6868-2fec-4971-90f8-5f88043121f2 tempest-ProjectReaderTests-1585707484 None] Deleted volume successfully. Sep 05 11:52:21 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-33b2eea7-0883-4224-ad85-321303a4388e tempest-ProjectReaderTests-1534806197 None] Create snapshot completed successfully Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-611b6868-2fec-4971-90f8-5f88043121f2 tempest-ProjectReaderTests-1585707484 None] Lock "cinder-6b5ea35a-0638-4e92-ad99-1f30108ea79e-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] Flow 'volume_create_manager' (860bae75-f563-4af6-9781-f813172cde53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:52:21 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf01a78b-ec56-47a2-ad88-8b74f497f0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-012ee5c7-a3f2-4088-ac70-e98452fa1d37 tempest-CinderUnicodeTest-1820328059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ecc687b1-751c-4f61-a67f-82f96087bbba" returned: 0 in 0.560s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-012ee5c7-a3f2-4088-ac70-e98452fa1d37 tempest-CinderUnicodeTest-1820328059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ecc687b1-751c-4f61-a67f-82f96087bbba {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf01a78b-ec56-47a2-ad88-8b74f497f0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1403489851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3099df2c-2e1c-481e-82b4-3b3f80babb67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d60ba3b97dd749afb0b1b78f89c6c447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:52:21Z,use_quota=True,user_id='21f0c1b339b24b9991544f21176ed9f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:21 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ecc687b1-751c-4f61-a67f-82f96087bbba Sep 05 11:52:21 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b96ce1ed-e639-490f-9dbd-ea5eacab59f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b96ce1ed-e639-490f-9dbd-ea5eacab59f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8607721-1f47-4f49-8982-f3ffb592d3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8607721-1f47-4f49-8982-f3ffb592d3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3099df2c-2e1c-481e-82b4-3b3f80babb67', 'volume_name': 'volume-3099df2c-2e1c-481e-82b4-3b3f80babb67', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c96ca3-baad-46c3-9a57-2d691e11e2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c96ca3-baad-46c3-9a57-2d691e11e2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28705803-1d0b-4bb5-a31e-9cf10725c757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:21 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] Volume 3099df2c-2e1c-481e-82b4-3b3f80babb67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3099df2c-2e1c-481e-82b4-3b3f80babb67', 'volume_size': 1} Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1403489851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3099df2c-2e1c-481e-82b4-3b3f80babb67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d60ba3b97dd749afb0b1b78f89c6c447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:52:21Z,use_quota=True,user_id='21f0c1b339b24b9991544f21176ed9f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] Creating volume 3099df2c-2e1c-481e-82b4-3b3f80babb67 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:52:21 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3099df2c-2e1c-481e-82b4-3b3f80babb67 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:21 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3099df2c-2e1c-481e-82b4-3b3f80babb67 1073741824 Sep 05 11:52:21 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:21 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-012ee5c7-a3f2-4088-ac70-e98452fa1d37 tempest-CinderUnicodeTest-1820328059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-ecc687b1-751c-4f61-a67f-82f96087bbba" returned: 0 in 0.301s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-012ee5c7-a3f2-4088-ac70-e98452fa1d37 tempest-CinderUnicodeTest-1820328059 None] Lock "cinder-quobyte-ecc687b1-751c-4f61-a67f-82f96087bbba" released by "delete_volume" :: held 0.946s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-012ee5c7-a3f2-4088-ac70-e98452fa1d37 tempest-CinderUnicodeTest-1820328059 None] Created reservations ['6e29501f-3bac-42bf-8c7b-39cfe8eb6387', '9fa1f32b-7625-497f-beb9-355426d298be', '5b8e6c03-47f2-49e6-995b-af7c1ab8eda3', 'f01564cd-fd9c-4dc4-80b1-36cdd06d84a5'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-012ee5c7-a3f2-4088-ac70-e98452fa1d37 tempest-CinderUnicodeTest-1820328059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-012ee5c7-a3f2-4088-ac70-e98452fa1d37 tempest-CinderUnicodeTest-1820328059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-012ee5c7-a3f2-4088-ac70-e98452fa1d37 tempest-CinderUnicodeTest-1820328059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-012ee5c7-a3f2-4088-ac70-e98452fa1d37 tempest-CinderUnicodeTest-1820328059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-012ee5c7-a3f2-4088-ac70-e98452fa1d37 tempest-CinderUnicodeTest-1820328059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-012ee5c7-a3f2-4088-ac70-e98452fa1d37 tempest-CinderUnicodeTest-1820328059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:21 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:52:21 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2d50bc10-01ba-4f0d-bc18-e917551c2127 tempest-ProjectReaderTests-1534806197 None] Acquiring lock "cinder-aa0d7d29-a187-4eef-a39c-1254c2dc9d64-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2d50bc10-01ba-4f0d-bc18-e917551c2127 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-aa0d7d29-a187-4eef-a39c-1254c2dc9d64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2d50bc10-01ba-4f0d-bc18-e917551c2127 tempest-ProjectReaderTests-1534806197 None] Acquiring lock "cinder-quobyte-7a59970c-869d-45e8-9439-20d75a95b649" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2d50bc10-01ba-4f0d-bc18-e917551c2127 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-quobyte-7a59970c-869d-45e8-9439-20d75a95b649" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2d50bc10-01ba-4f0d-bc18-e917551c2127 tempest-ProjectReaderTests-1534806197 None] Acquiring lock "cinder-quobyte-aa0d7d29-a187-4eef-a39c-1254c2dc9d64" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:22 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3099df2c-2e1c-481e-82b4-3b3f80babb67 1073741824" returned: 0 in 0.580s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2d50bc10-01ba-4f0d-bc18-e917551c2127 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-quobyte-aa0d7d29-a187-4eef-a39c-1254c2dc9d64" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-2d50bc10-01ba-4f0d-bc18-e917551c2127 tempest-ProjectReaderTests-1534806197 None] Deleting offline snapshot aa0d7d29-a187-4eef-a39c-1254c2dc9d64 of volume 7a59970c-869d-45e8-9439-20d75a95b649 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:52:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-2d50bc10-01ba-4f0d-bc18-e917551c2127 tempest-ProjectReaderTests-1534806197 None] snapshot_file for this snap is: volume-7a59970c-869d-45e8-9439-20d75a95b649.aa0d7d29-a187-4eef-a39c-1254c2dc9d64 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:52:22 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58f1437-1aa5-48dd-9649-c338806c99f2]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2d50bc10-01ba-4f0d-bc18-e917551c2127 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649.aa0d7d29-a187-4eef-a39c-1254c2dc9d64 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3099df2c-2e1c-481e-82b4-3b3f80babb67 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:22 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-012ee5c7-a3f2-4088-ac70-e98452fa1d37 tempest-CinderUnicodeTest-1820328059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.286s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:22 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-012ee5c7-a3f2-4088-ac70-e98452fa1d37 tempest-CinderUnicodeTest-1820328059 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:52:22 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-012ee5c7-a3f2-4088-ac70-e98452fa1d37 tempest-CinderUnicodeTest-1820328059 None] Deleted volume successfully. Sep 05 11:52:22 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3099df2c-2e1c-481e-82b4-3b3f80babb67 Sep 05 11:52:22 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:22 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-012ee5c7-a3f2-4088-ac70-e98452fa1d37 tempest-CinderUnicodeTest-1820328059 None] Lock "cinder-ecc687b1-751c-4f61-a67f-82f96087bbba-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:22 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649.aa0d7d29-a187-4eef-a39c-1254c2dc9d64 Sep 05 11:52:22 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:22 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3099df2c-2e1c-481e-82b4-3b3f80babb67" returned: 0 in 0.273s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:52:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28705803-1d0b-4bb5-a31e-9cf10725c757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3099df2c-2e1c-481e-82b4-3b3f80babb67', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ae9c690-d758-4cfe-8b54-e123997a4e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:22 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] Volume volume-3099df2c-2e1c-481e-82b4-3b3f80babb67 (3099df2c-2e1c-481e-82b4-3b3f80babb67): created successfully Sep 05 11:52:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ae9c690-d758-4cfe-8b54-e123997a4e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:22 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] Flow 'volume_create_manager' (860bae75-f563-4af6-9781-f813172cde53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:52:22 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-8c1bc68f-f2b4-41b1-a5ad-338c04f7c4f9 tempest-ProjectReaderTests-1585707484 None] Created volume successfully. Sep 05 11:52:22 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2d50bc10-01ba-4f0d-bc18-e917551c2127 tempest-ProjectReaderTests-1534806197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649.aa0d7d29-a187-4eef-a39c-1254c2dc9d64" returned: 0 in 0.408s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-2d50bc10-01ba-4f0d-bc18-e917551c2127 tempest-ProjectReaderTests-1534806197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a59970c-869d-45e8-9439-20d75a95b649(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:52:22 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5435ee4-425f-497f-a6b5-3ae391f12e91]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2d50bc10-01ba-4f0d-bc18-e917551c2127 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:22 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649 Sep 05 11:52:22 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:22 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2d50bc10-01ba-4f0d-bc18-e917551c2127 tempest-ProjectReaderTests-1534806197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649" returned: 0 in 0.433s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2d50bc10-01ba-4f0d-bc18-e917551c2127 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649.aa0d7d29-a187-4eef-a39c-1254c2dc9d64 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:23 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649.aa0d7d29-a187-4eef-a39c-1254c2dc9d64 Sep 05 11:52:23 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:23 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2d50bc10-01ba-4f0d-bc18-e917551c2127 tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649.aa0d7d29-a187-4eef-a39c-1254c2dc9d64" returned: 0 in 0.428s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2d50bc10-01ba-4f0d-bc18-e917551c2127 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649.aa0d7d29-a187-4eef-a39c-1254c2dc9d64 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:23 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649.aa0d7d29-a187-4eef-a39c-1254c2dc9d64 Sep 05 11:52:23 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ce4b0fd1-8191-4066-a6a5-a9f3a2e31558 tempest-ProjectReaderTests-1585707484 None] Acquiring lock "cinder-3099df2c-2e1c-481e-82b4-3b3f80babb67-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ce4b0fd1-8191-4066-a6a5-a9f3a2e31558 tempest-ProjectReaderTests-1585707484 None] Lock "cinder-3099df2c-2e1c-481e-82b4-3b3f80babb67-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ce4b0fd1-8191-4066-a6a5-a9f3a2e31558 tempest-ProjectReaderTests-1585707484 None] Acquiring lock "cinder-quobyte-3099df2c-2e1c-481e-82b4-3b3f80babb67" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ce4b0fd1-8191-4066-a6a5-a9f3a2e31558 tempest-ProjectReaderTests-1585707484 None] Lock "cinder-quobyte-3099df2c-2e1c-481e-82b4-3b3f80babb67" acquired by "delete_volume" :: waited 0.030s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:23 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b0a6c8-12f2-4120-8f81-507ed223bddc]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ce4b0fd1-8191-4066-a6a5-a9f3a2e31558 tempest-ProjectReaderTests-1585707484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3099df2c-2e1c-481e-82b4-3b3f80babb67 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:23 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2d50bc10-01ba-4f0d-bc18-e917551c2127 tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649.aa0d7d29-a187-4eef-a39c-1254c2dc9d64" returned: 0 in 0.405s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2d50bc10-01ba-4f0d-bc18-e917551c2127 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-quobyte-aa0d7d29-a187-4eef-a39c-1254c2dc9d64" released by "_delete_snapshot" :: held 1.781s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2d50bc10-01ba-4f0d-bc18-e917551c2127 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-quobyte-7a59970c-869d-45e8-9439-20d75a95b649" released by "delete_snapshot" :: held 1.815s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:23 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3099df2c-2e1c-481e-82b4-3b3f80babb67 Sep 05 11:52:23 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:23 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-2d50bc10-01ba-4f0d-bc18-e917551c2127 tempest-ProjectReaderTests-1534806197 None] Created reservations ['27b3a000-1351-4664-9b50-b4e00af2e059', '492c551c-b9dc-4310-95e1-e3a0a7abd91f', '2496ea42-dded-4f2f-9d25-f45617efb232', 'a2bea2e0-a1ce-4d82-8e11-6edbb8833bb6'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:52:24 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2d50bc10-01ba-4f0d-bc18-e917551c2127 tempest-ProjectReaderTests-1534806197 None] Delete snapshot completed successfully. Sep 05 11:52:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2d50bc10-01ba-4f0d-bc18-e917551c2127 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-aa0d7d29-a187-4eef-a39c-1254c2dc9d64-delete_snapshot" released by "delete_snapshot" :: held 2.017s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-70bd0bc2-3886-4dff-aa25-eca9793409a6 tempest-ProjectReaderTests-1534806197 None] Acquiring lock "cinder-7a59970c-869d-45e8-9439-20d75a95b649-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:24 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ce4b0fd1-8191-4066-a6a5-a9f3a2e31558 tempest-ProjectReaderTests-1585707484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3099df2c-2e1c-481e-82b4-3b3f80babb67" returned: 0 in 0.464s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ce4b0fd1-8191-4066-a6a5-a9f3a2e31558 tempest-ProjectReaderTests-1585707484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3099df2c-2e1c-481e-82b4-3b3f80babb67 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-70bd0bc2-3886-4dff-aa25-eca9793409a6 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-7a59970c-869d-45e8-9439-20d75a95b649-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:24 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3099df2c-2e1c-481e-82b4-3b3f80babb67 Sep 05 11:52:24 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-70bd0bc2-3886-4dff-aa25-eca9793409a6 tempest-ProjectReaderTests-1534806197 None] Acquiring lock "cinder-quobyte-7a59970c-869d-45e8-9439-20d75a95b649" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-70bd0bc2-3886-4dff-aa25-eca9793409a6 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-quobyte-7a59970c-869d-45e8-9439-20d75a95b649" acquired by "delete_volume" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:24 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[53715b82-c986-4782-ba38-443261f5847a]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-70bd0bc2-3886-4dff-aa25-eca9793409a6 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:24 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649 Sep 05 11:52:24 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:24 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ce4b0fd1-8191-4066-a6a5-a9f3a2e31558 tempest-ProjectReaderTests-1585707484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3099df2c-2e1c-481e-82b4-3b3f80babb67" returned: 0 in 0.327s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ce4b0fd1-8191-4066-a6a5-a9f3a2e31558 tempest-ProjectReaderTests-1585707484 None] Lock "cinder-quobyte-3099df2c-2e1c-481e-82b4-3b3f80babb67" released by "delete_volume" :: held 0.875s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:24 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-ce4b0fd1-8191-4066-a6a5-a9f3a2e31558 tempest-ProjectReaderTests-1585707484 None] Created reservations ['70735b49-372e-4926-9a02-b4b387b63514', '2514133f-84b0-4ba6-99b3-44a030c52963', '7e93e832-832f-48f7-aefc-61a834818b44', '0634f418-69dd-4ccf-ab17-70bec11ae46b'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:52:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ce4b0fd1-8191-4066-a6a5-a9f3a2e31558 tempest-ProjectReaderTests-1585707484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ce4b0fd1-8191-4066-a6a5-a9f3a2e31558 tempest-ProjectReaderTests-1585707484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ce4b0fd1-8191-4066-a6a5-a9f3a2e31558 tempest-ProjectReaderTests-1585707484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ce4b0fd1-8191-4066-a6a5-a9f3a2e31558 tempest-ProjectReaderTests-1585707484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ce4b0fd1-8191-4066-a6a5-a9f3a2e31558 tempest-ProjectReaderTests-1585707484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ce4b0fd1-8191-4066-a6a5-a9f3a2e31558 tempest-ProjectReaderTests-1585707484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:24 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:52:24 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:24 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-70bd0bc2-3886-4dff-aa25-eca9793409a6 tempest-ProjectReaderTests-1534806197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649" returned: 0 in 0.521s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-70bd0bc2-3886-4dff-aa25-eca9793409a6 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:24 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649 Sep 05 11:52:24 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:25 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ce4b0fd1-8191-4066-a6a5-a9f3a2e31558 tempest-ProjectReaderTests-1585707484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.310s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:25 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-ce4b0fd1-8191-4066-a6a5-a9f3a2e31558 tempest-ProjectReaderTests-1585707484 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:52:25 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ce4b0fd1-8191-4066-a6a5-a9f3a2e31558 tempest-ProjectReaderTests-1585707484 None] Deleted volume successfully. Sep 05 11:52:25 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ce4b0fd1-8191-4066-a6a5-a9f3a2e31558 tempest-ProjectReaderTests-1585707484 None] Lock "cinder-3099df2c-2e1c-481e-82b4-3b3f80babb67-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-70bd0bc2-3886-4dff-aa25-eca9793409a6 tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-7a59970c-869d-45e8-9439-20d75a95b649" returned: 0 in 0.330s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-70bd0bc2-3886-4dff-aa25-eca9793409a6 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-quobyte-7a59970c-869d-45e8-9439-20d75a95b649" released by "delete_volume" :: held 0.925s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:25 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-70bd0bc2-3886-4dff-aa25-eca9793409a6 tempest-ProjectReaderTests-1534806197 None] Created reservations ['c72b393d-d4f7-4c08-9b59-9dbbe3540f08', 'ca82d10c-67c8-48e8-8471-69bbd50d4bfd', 'cdd5aabd-1f16-4cd0-9dbb-2ec4637a2b2d', '59fc2b1c-be50-4c63-a868-dba8799b0d8a'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:52:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-70bd0bc2-3886-4dff-aa25-eca9793409a6 tempest-ProjectReaderTests-1534806197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-70bd0bc2-3886-4dff-aa25-eca9793409a6 tempest-ProjectReaderTests-1534806197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-70bd0bc2-3886-4dff-aa25-eca9793409a6 tempest-ProjectReaderTests-1534806197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-70bd0bc2-3886-4dff-aa25-eca9793409a6 tempest-ProjectReaderTests-1534806197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-70bd0bc2-3886-4dff-aa25-eca9793409a6 tempest-ProjectReaderTests-1534806197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-70bd0bc2-3886-4dff-aa25-eca9793409a6 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:25 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:52:25 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:25 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-70bd0bc2-3886-4dff-aa25-eca9793409a6 tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.267s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:25 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-70bd0bc2-3886-4dff-aa25-eca9793409a6 tempest-ProjectReaderTests-1534806197 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:52:25 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-70bd0bc2-3886-4dff-aa25-eca9793409a6 tempest-ProjectReaderTests-1534806197 None] Deleted volume successfully. Sep 05 11:52:25 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-70bd0bc2-3886-4dff-aa25-eca9793409a6 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-7a59970c-869d-45e8-9439-20d75a95b649-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:26 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:52:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] Flow 'volume_create_manager' (bd47d77b-4657-4dbe-aa3b-1aeb87b9ea47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:52:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb33be4-e22d-4fd7-98d2-12a0d94784e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb33be4-e22d-4fd7-98d2-12a0d94784e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1928939503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf69a52b-7ac2-4139-84aa-ebe99519f0e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d60ba3b97dd749afb0b1b78f89c6c447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:52:26Z,use_quota=True,user_id='21f0c1b339b24b9991544f21176ed9f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df22411a-25f5-463d-af90-3ccc55978a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df22411a-25f5-463d-af90-3ccc55978a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (922b35d0-9dd9-4129-b6b7-fb76e9b3467b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (922b35d0-9dd9-4129-b6b7-fb76e9b3467b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf69a52b-7ac2-4139-84aa-ebe99519f0e5', 'volume_name': 'volume-bf69a52b-7ac2-4139-84aa-ebe99519f0e5', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888b816e-441a-4915-9b3a-9bb6db1e21ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888b816e-441a-4915-9b3a-9bb6db1e21ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b104797-4095-4f7c-a17a-52aa8e984e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:26 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] Volume bf69a52b-7ac2-4139-84aa-ebe99519f0e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf69a52b-7ac2-4139-84aa-ebe99519f0e5', 'volume_size': 1} Sep 05 11:52:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1928939503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf69a52b-7ac2-4139-84aa-ebe99519f0e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d60ba3b97dd749afb0b1b78f89c6c447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:52:26Z,use_quota=True,user_id='21f0c1b339b24b9991544f21176ed9f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:52:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] Creating volume bf69a52b-7ac2-4139-84aa-ebe99519f0e5 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:52:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:52:26 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:52:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-bf69a52b-7ac2-4139-84aa-ebe99519f0e5 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:26 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-bf69a52b-7ac2-4139-84aa-ebe99519f0e5 1073741824 Sep 05 11:52:26 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:27 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-bf69a52b-7ac2-4139-84aa-ebe99519f0e5 1073741824" returned: 0 in 0.570s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:27 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:52:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] Flow 'volume_create_manager' (174bed40-381e-4910-914b-f96114a8c0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:52:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdc34ff6-83e4-4e70-a5db-d09b57fd4bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdc34ff6-83e4-4e70-a5db-d09b57fd4bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-803132234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5216275-7716-4ca5-807a-9a0f1be15486,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19721c63425b45ed9804232ddcf1e000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:52:27Z,use_quota=True,user_id='335cdccede6c4f1eb437e1702bf54a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17be90f0-42fc-4fe7-a82c-fafdc32c0e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17be90f0-42fc-4fe7-a82c-fafdc32c0e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d385cf40-2905-47a1-873c-842c85b6f8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d385cf40-2905-47a1-873c-842c85b6f8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5216275-7716-4ca5-807a-9a0f1be15486', 'volume_name': 'volume-b5216275-7716-4ca5-807a-9a0f1be15486', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (070ed0f1-4c00-4920-9e8c-ac3ed2291556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (070ed0f1-4c00-4920-9e8c-ac3ed2291556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd42d513-d966-4e1d-8bea-7c799e55d57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:27 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] Volume b5216275-7716-4ca5-807a-9a0f1be15486: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5216275-7716-4ca5-807a-9a0f1be15486', 'volume_size': 1} Sep 05 11:52:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-bf69a52b-7ac2-4139-84aa-ebe99519f0e5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:27 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-bf69a52b-7ac2-4139-84aa-ebe99519f0e5 Sep 05 11:52:27 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:27 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-bf69a52b-7ac2-4139-84aa-ebe99519f0e5" returned: 0 in 0.259s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:52:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.279s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-803132234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5216275-7716-4ca5-807a-9a0f1be15486,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19721c63425b45ed9804232ddcf1e000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:52:27Z,use_quota=True,user_id='335cdccede6c4f1eb437e1702bf54a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:52:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] Creating volume b5216275-7716-4ca5-807a-9a0f1be15486 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:52:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:27 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:52:27 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:52:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:27 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486 1073741824 Sep 05 11:52:27 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b104797-4095-4f7c-a17a-52aa8e984e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf69a52b-7ac2-4139-84aa-ebe99519f0e5', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb1c5f3-012d-45ba-b805-142a5a6e86e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:27 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] Volume volume-bf69a52b-7ac2-4139-84aa-ebe99519f0e5 (bf69a52b-7ac2-4139-84aa-ebe99519f0e5): created successfully Sep 05 11:52:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb1c5f3-012d-45ba-b805-142a5a6e86e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:27 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] Flow 'volume_create_manager' (bd47d77b-4657-4dbe-aa3b-1aeb87b9ea47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:52:27 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-4cab4f25-da43-4e13-928f-3b3f8aa582df tempest-ProjectReaderTests-1585707484 None] Created volume successfully. Sep 05 11:52:28 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486 1073741824" returned: 0 in 0.558s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:28 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486 Sep 05 11:52:28 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:28 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486" returned: 0 in 0.257s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:52:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd42d513-d966-4e1d-8bea-7c799e55d57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5216275-7716-4ca5-807a-9a0f1be15486', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e049fffb-b176-4c3f-b19e-411ac717f234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:28 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] Volume volume-b5216275-7716-4ca5-807a-9a0f1be15486 (b5216275-7716-4ca5-807a-9a0f1be15486): created successfully Sep 05 11:52:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e049fffb-b176-4c3f-b19e-411ac717f234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:28 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] Flow 'volume_create_manager' (174bed40-381e-4910-914b-f96114a8c0ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:52:28 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-30f7b4ae-ae8a-4c76-bbb8-498b4c898779 tempest-ProjectReaderTests-1534806197 None] Created volume successfully. Sep 05 11:52:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c5fb59b3-1339-48d7-b25c-83172bb438e6 tempest-ProjectReaderTests-1585707484 None] Acquiring lock "cinder-bf69a52b-7ac2-4139-84aa-ebe99519f0e5-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c5fb59b3-1339-48d7-b25c-83172bb438e6 tempest-ProjectReaderTests-1585707484 None] Lock "cinder-bf69a52b-7ac2-4139-84aa-ebe99519f0e5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c5fb59b3-1339-48d7-b25c-83172bb438e6 tempest-ProjectReaderTests-1585707484 None] Acquiring lock "cinder-quobyte-bf69a52b-7ac2-4139-84aa-ebe99519f0e5" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c5fb59b3-1339-48d7-b25c-83172bb438e6 tempest-ProjectReaderTests-1585707484 None] Lock "cinder-quobyte-bf69a52b-7ac2-4139-84aa-ebe99519f0e5" acquired by "delete_volume" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:28 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8028b5-87eb-493c-b963-c5990bfa619c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5fb59b3-1339-48d7-b25c-83172bb438e6 tempest-ProjectReaderTests-1585707484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-bf69a52b-7ac2-4139-84aa-ebe99519f0e5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:28 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-bf69a52b-7ac2-4139-84aa-ebe99519f0e5 Sep 05 11:52:28 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:29 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5fb59b3-1339-48d7-b25c-83172bb438e6 tempest-ProjectReaderTests-1585707484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-bf69a52b-7ac2-4139-84aa-ebe99519f0e5" returned: 0 in 0.405s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5fb59b3-1339-48d7-b25c-83172bb438e6 tempest-ProjectReaderTests-1585707484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-bf69a52b-7ac2-4139-84aa-ebe99519f0e5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:29 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-bf69a52b-7ac2-4139-84aa-ebe99519f0e5 Sep 05 11:52:29 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:29 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5fb59b3-1339-48d7-b25c-83172bb438e6 tempest-ProjectReaderTests-1585707484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-bf69a52b-7ac2-4139-84aa-ebe99519f0e5" returned: 0 in 0.328s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c5fb59b3-1339-48d7-b25c-83172bb438e6 tempest-ProjectReaderTests-1585707484 None] Lock "cinder-quobyte-bf69a52b-7ac2-4139-84aa-ebe99519f0e5" released by "delete_volume" :: held 0.805s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c20b4724-a0fa-48ec-9671-daed92a4dfe5 tempest-ProjectReaderTests-1534806197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c20b4724-a0fa-48ec-9671-daed92a4dfe5 tempest-ProjectReaderTests-1534806197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-c20b4724-a0fa-48ec-9671-daed92a4dfe5 tempest-ProjectReaderTests-1534806197 None] Creating offline snapshot 32bb2a71-8682-48d2-b91b-2d7701dabe37 of volume b5216275-7716-4ca5-807a-9a0f1be15486 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:52:29 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-c5fb59b3-1339-48d7-b25c-83172bb438e6 tempest-ProjectReaderTests-1585707484 None] Created reservations ['c9354e3a-f2cc-4835-870f-f79acd64a3bb', 'a7882c88-37e8-4246-bdb3-be0e22aba3ce', '3b73fa6a-40cf-4b08-81d3-97a16fbab254', 'cb790e95-ae5f-46db-89e3-c351ef95fc28'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:52:29 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1658d1-b703-41b0-a9bc-2f00299cceb9]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c20b4724-a0fa-48ec-9671-daed92a4dfe5 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c5fb59b3-1339-48d7-b25c-83172bb438e6 tempest-ProjectReaderTests-1585707484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c5fb59b3-1339-48d7-b25c-83172bb438e6 tempest-ProjectReaderTests-1585707484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c5fb59b3-1339-48d7-b25c-83172bb438e6 tempest-ProjectReaderTests-1585707484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c5fb59b3-1339-48d7-b25c-83172bb438e6 tempest-ProjectReaderTests-1585707484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c5fb59b3-1339-48d7-b25c-83172bb438e6 tempest-ProjectReaderTests-1585707484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5fb59b3-1339-48d7-b25c-83172bb438e6 tempest-ProjectReaderTests-1585707484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:29 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486 Sep 05 11:52:29 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:29 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:52:29 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:30 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c5fb59b3-1339-48d7-b25c-83172bb438e6 tempest-ProjectReaderTests-1585707484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.351s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:30 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-c5fb59b3-1339-48d7-b25c-83172bb438e6 tempest-ProjectReaderTests-1585707484 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:52:30 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c5fb59b3-1339-48d7-b25c-83172bb438e6 tempest-ProjectReaderTests-1585707484 None] Deleted volume successfully. Sep 05 11:52:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-c5fb59b3-1339-48d7-b25c-83172bb438e6 tempest-ProjectReaderTests-1585707484 None] Lock "cinder-bf69a52b-7ac2-4139-84aa-ebe99519f0e5-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:30 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c20b4724-a0fa-48ec-9671-daed92a4dfe5 tempest-ProjectReaderTests-1534806197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486" returned: 0 in 0.638s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c20b4724-a0fa-48ec-9671-daed92a4dfe5 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486.32bb2a71-8682-48d2-b91b-2d7701dabe37 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:30 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486.32bb2a71-8682-48d2-b91b-2d7701dabe37 1G Sep 05 11:52:30 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:30 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c20b4724-a0fa-48ec-9671-daed92a4dfe5 tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486.32bb2a71-8682-48d2-b91b-2d7701dabe37 1G" returned: 0 in 0.504s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c20b4724-a0fa-48ec-9671-daed92a4dfe5 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5216275-7716-4ca5-807a-9a0f1be15486 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486.32bb2a71-8682-48d2-b91b-2d7701dabe37 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:30 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5216275-7716-4ca5-807a-9a0f1be15486 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486.32bb2a71-8682-48d2-b91b-2d7701dabe37 Sep 05 11:52:30 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:31 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c20b4724-a0fa-48ec-9671-daed92a4dfe5 tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5216275-7716-4ca5-807a-9a0f1be15486 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486.32bb2a71-8682-48d2-b91b-2d7701dabe37" returned: 0 in 0.353s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:31 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-c20b4724-a0fa-48ec-9671-daed92a4dfe5 tempest-ProjectReaderTests-1534806197 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486.32bb2a71-8682-48d2-b91b-2d7701dabe37 is being set with open permissions: ugo+rw Sep 05 11:52:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c20b4724-a0fa-48ec-9671-daed92a4dfe5 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486.32bb2a71-8682-48d2-b91b-2d7701dabe37 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:31 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486.32bb2a71-8682-48d2-b91b-2d7701dabe37 Sep 05 11:52:31 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:31 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c20b4724-a0fa-48ec-9671-daed92a4dfe5 tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486.32bb2a71-8682-48d2-b91b-2d7701dabe37" returned: 0 in 0.336s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c20b4724-a0fa-48ec-9671-daed92a4dfe5 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:31 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486.info Sep 05 11:52:31 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:31 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c20b4724-a0fa-48ec-9671-daed92a4dfe5 tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486.info" returned: 0 in 0.313s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:31 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-c20b4724-a0fa-48ec-9671-daed92a4dfe5 tempest-ProjectReaderTests-1534806197 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486.info is being set with open permissions: ugo+rw Sep 05 11:52:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c20b4724-a0fa-48ec-9671-daed92a4dfe5 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:31 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486.info Sep 05 11:52:31 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:32 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c20b4724-a0fa-48ec-9671-daed92a4dfe5 tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486.info" returned: 0 in 0.302s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c20b4724-a0fa-48ec-9671-daed92a4dfe5 tempest-ProjectReaderTests-1534806197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.559s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:32 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c20b4724-a0fa-48ec-9671-daed92a4dfe5 tempest-ProjectReaderTests-1534806197 None] Create snapshot completed successfully Sep 05 11:52:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:52:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:32 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:52:32 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:32 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.246s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:32 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:52:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:52:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread count: 28 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 11:52:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread info: [<_MainThread(MainThread, started 131707869511808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 11:52:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-50c69108-8674-402e-99a3-35e692830e91 tempest-ProjectReaderTests-1534806197 None] Acquiring lock "cinder-32bb2a71-8682-48d2-b91b-2d7701dabe37-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-50c69108-8674-402e-99a3-35e692830e91 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-32bb2a71-8682-48d2-b91b-2d7701dabe37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-50c69108-8674-402e-99a3-35e692830e91 tempest-ProjectReaderTests-1534806197 None] Acquiring lock "cinder-quobyte-b5216275-7716-4ca5-807a-9a0f1be15486" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-50c69108-8674-402e-99a3-35e692830e91 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-quobyte-b5216275-7716-4ca5-807a-9a0f1be15486" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-50c69108-8674-402e-99a3-35e692830e91 tempest-ProjectReaderTests-1534806197 None] Acquiring lock "cinder-quobyte-32bb2a71-8682-48d2-b91b-2d7701dabe37" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:32 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-50c69108-8674-402e-99a3-35e692830e91 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-quobyte-32bb2a71-8682-48d2-b91b-2d7701dabe37" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-50c69108-8674-402e-99a3-35e692830e91 tempest-ProjectReaderTests-1534806197 None] Deleting offline snapshot 32bb2a71-8682-48d2-b91b-2d7701dabe37 of volume b5216275-7716-4ca5-807a-9a0f1be15486 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:52:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-50c69108-8674-402e-99a3-35e692830e91 tempest-ProjectReaderTests-1534806197 None] snapshot_file for this snap is: volume-b5216275-7716-4ca5-807a-9a0f1be15486.32bb2a71-8682-48d2-b91b-2d7701dabe37 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:52:32 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7cecc5-618e-41cd-b226-819bb7d8000c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-50c69108-8674-402e-99a3-35e692830e91 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486.32bb2a71-8682-48d2-b91b-2d7701dabe37 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:32 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486.32bb2a71-8682-48d2-b91b-2d7701dabe37 Sep 05 11:52:32 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:33 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-50c69108-8674-402e-99a3-35e692830e91 tempest-ProjectReaderTests-1534806197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486.32bb2a71-8682-48d2-b91b-2d7701dabe37" returned: 0 in 0.380s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-50c69108-8674-402e-99a3-35e692830e91 tempest-ProjectReaderTests-1534806197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5216275-7716-4ca5-807a-9a0f1be15486(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:52:33 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f767675-2656-496f-94c4-912999839227]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-50c69108-8674-402e-99a3-35e692830e91 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:52:33 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486 Sep 05 11:52:33 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] Flow 'volume_create_manager' (f444fa59-2075-49c0-b74a-2cd898eb3064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc27072-2499-4547-b3bd-9ec14b5900f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc27072-2499-4547-b3bd-9ec14b5900f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1542041955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7d6912a-d3aa-4605-b832-6c8aba7b2a6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47eb7f5800ca42a8aac1df1019b50492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:52:33Z,use_quota=True,user_id='4498bbe7acb84612bf0e189659c0581e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ca8d7c-f6e3-4fc2-8088-69d7d3506921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ca8d7c-f6e3-4fc2-8088-69d7d3506921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caca75df-f821-47ae-8cf6-4446725c6cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caca75df-f821-47ae-8cf6-4446725c6cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7d6912a-d3aa-4605-b832-6c8aba7b2a6d', 'volume_name': 'volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b137d9-eb86-44cb-ad01-4114c9af725f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b137d9-eb86-44cb-ad01-4114c9af725f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (137df7e7-1ff3-420d-bd50-863c2132f359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:33 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] Volume d7d6912a-d3aa-4605-b832-6c8aba7b2a6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d', 'volume_size': 1} Sep 05 11:52:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1542041955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7d6912a-d3aa-4605-b832-6c8aba7b2a6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47eb7f5800ca42a8aac1df1019b50492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:52:33Z,use_quota=True,user_id='4498bbe7acb84612bf0e189659c0581e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] Creating volume d7d6912a-d3aa-4605-b832-6c8aba7b2a6d {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:52:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:52:33 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:52:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:33 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d 1073741824 Sep 05 11:52:33 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:33 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-50c69108-8674-402e-99a3-35e692830e91 tempest-ProjectReaderTests-1534806197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486" returned: 0 in 0.355s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-50c69108-8674-402e-99a3-35e692830e91 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486.32bb2a71-8682-48d2-b91b-2d7701dabe37 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:33 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486.32bb2a71-8682-48d2-b91b-2d7701dabe37 Sep 05 11:52:33 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:33 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d 1073741824" returned: 0 in 0.413s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:33 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d Sep 05 11:52:33 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:33 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-50c69108-8674-402e-99a3-35e692830e91 tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486.32bb2a71-8682-48d2-b91b-2d7701dabe37" returned: 0 in 0.374s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-50c69108-8674-402e-99a3-35e692830e91 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486.32bb2a71-8682-48d2-b91b-2d7701dabe37 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:33 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486.32bb2a71-8682-48d2-b91b-2d7701dabe37 Sep 05 11:52:33 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:34 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d" returned: 0 in 0.245s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:34 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:52:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (137df7e7-1ff3-420d-bd50-863c2132f359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be18cea-7073-4c58-bfea-5d0583c7c45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:34 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] Volume volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d (d7d6912a-d3aa-4605-b832-6c8aba7b2a6d): created successfully Sep 05 11:52:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be18cea-7073-4c58-bfea-5d0583c7c45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:34 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] Flow 'volume_create_manager' (f444fa59-2075-49c0-b74a-2cd898eb3064) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:52:34 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-bf2f37ea-2545-4f94-9888-ef1c4a245249 tempest-ProjectMemberTests-1275208846 None] Created volume successfully. Sep 05 11:52:34 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-50c69108-8674-402e-99a3-35e692830e91 tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486.32bb2a71-8682-48d2-b91b-2d7701dabe37" returned: 0 in 0.247s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-50c69108-8674-402e-99a3-35e692830e91 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-quobyte-32bb2a71-8682-48d2-b91b-2d7701dabe37" released by "_delete_snapshot" :: held 1.460s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-50c69108-8674-402e-99a3-35e692830e91 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-quobyte-b5216275-7716-4ca5-807a-9a0f1be15486" released by "delete_snapshot" :: held 1.484s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:34 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-50c69108-8674-402e-99a3-35e692830e91 tempest-ProjectReaderTests-1534806197 None] Created reservations ['c4ddbeb7-267e-4adb-9f0b-44eac2801d71', '29f3a240-4918-47d6-a52a-b4a458435b2a', '5b22d5a6-1a75-48b1-8d96-7f88d53da6ef', '5768ff3b-23f8-4d78-a5b0-d819964db21a'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:52:34 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-50c69108-8674-402e-99a3-35e692830e91 tempest-ProjectReaderTests-1534806197 None] Delete snapshot completed successfully. Sep 05 11:52:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-50c69108-8674-402e-99a3-35e692830e91 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-32bb2a71-8682-48d2-b91b-2d7701dabe37-delete_snapshot" released by "delete_snapshot" :: held 1.624s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ed42b2fa-d212-468f-9432-c5d6cc5dd3a7 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ed42b2fa-d212-468f-9432-c5d6cc5dd3a7 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:34 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-ed42b2fa-d212-468f-9432-c5d6cc5dd3a7 tempest-ProjectMemberTests-1275208846 None] Creating offline snapshot 61dcc9c9-0c28-4f90-9e8f-eea620fede52 of volume d7d6912a-d3aa-4605-b832-6c8aba7b2a6d {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:52:34 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ed8b35-cc8c-43cf-ab3d-e82c9dc68527]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ed42b2fa-d212-468f-9432-c5d6cc5dd3a7 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:34 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d Sep 05 11:52:34 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3be68c86-c879-434e-aadf-bd2539ed5a17 tempest-ProjectReaderTests-1534806197 None] Acquiring lock "cinder-b5216275-7716-4ca5-807a-9a0f1be15486-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3be68c86-c879-434e-aadf-bd2539ed5a17 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-b5216275-7716-4ca5-807a-9a0f1be15486-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3be68c86-c879-434e-aadf-bd2539ed5a17 tempest-ProjectReaderTests-1534806197 None] Acquiring lock "cinder-quobyte-b5216275-7716-4ca5-807a-9a0f1be15486" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:34 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3be68c86-c879-434e-aadf-bd2539ed5a17 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-quobyte-b5216275-7716-4ca5-807a-9a0f1be15486" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:34 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee711da-1c16-4d65-8359-e4d9af88d5b6]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3be68c86-c879-434e-aadf-bd2539ed5a17 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:35 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ed42b2fa-d212-468f-9432-c5d6cc5dd3a7 tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d" returned: 0 in 0.395s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ed42b2fa-d212-468f-9432-c5d6cc5dd3a7 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d.61dcc9c9-0c28-4f90-9e8f-eea620fede52 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:35 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d.61dcc9c9-0c28-4f90-9e8f-eea620fede52 1G Sep 05 11:52:35 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:35 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486 Sep 05 11:52:35 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:35 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3be68c86-c879-434e-aadf-bd2539ed5a17 tempest-ProjectReaderTests-1534806197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486" returned: 0 in 0.372s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3be68c86-c879-434e-aadf-bd2539ed5a17 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:35 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486 Sep 05 11:52:35 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:35 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ed42b2fa-d212-468f-9432-c5d6cc5dd3a7 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d.61dcc9c9-0c28-4f90-9e8f-eea620fede52 1G" returned: 0 in 0.383s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ed42b2fa-d212-468f-9432-c5d6cc5dd3a7 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d.61dcc9c9-0c28-4f90-9e8f-eea620fede52 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:35 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d.61dcc9c9-0c28-4f90-9e8f-eea620fede52 Sep 05 11:52:35 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:35 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3be68c86-c879-434e-aadf-bd2539ed5a17 tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-b5216275-7716-4ca5-807a-9a0f1be15486" returned: 0 in 0.259s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3be68c86-c879-434e-aadf-bd2539ed5a17 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-quobyte-b5216275-7716-4ca5-807a-9a0f1be15486" released by "delete_volume" :: held 0.698s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:35 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-3be68c86-c879-434e-aadf-bd2539ed5a17 tempest-ProjectReaderTests-1534806197 None] Created reservations ['d994a7c2-06b5-445e-8e56-403b4e46394a', '8a6dd7ae-c901-4592-8276-91021233b38b', '38575cf7-495a-4465-9a7f-62a9ef27444a', 'ab92ce75-66aa-46bd-91fb-12564deaef48'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:52:35 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ed42b2fa-d212-468f-9432-c5d6cc5dd3a7 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d.61dcc9c9-0c28-4f90-9e8f-eea620fede52" returned: 0 in 0.310s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:35 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-ed42b2fa-d212-468f-9432-c5d6cc5dd3a7 tempest-ProjectMemberTests-1275208846 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d.61dcc9c9-0c28-4f90-9e8f-eea620fede52 is being set with open permissions: ugo+rw Sep 05 11:52:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ed42b2fa-d212-468f-9432-c5d6cc5dd3a7 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d.61dcc9c9-0c28-4f90-9e8f-eea620fede52 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:35 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d.61dcc9c9-0c28-4f90-9e8f-eea620fede52 Sep 05 11:52:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3be68c86-c879-434e-aadf-bd2539ed5a17 tempest-ProjectReaderTests-1534806197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:35 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3be68c86-c879-434e-aadf-bd2539ed5a17 tempest-ProjectReaderTests-1534806197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3be68c86-c879-434e-aadf-bd2539ed5a17 tempest-ProjectReaderTests-1534806197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-3be68c86-c879-434e-aadf-bd2539ed5a17 tempest-ProjectReaderTests-1534806197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3be68c86-c879-434e-aadf-bd2539ed5a17 tempest-ProjectReaderTests-1534806197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3be68c86-c879-434e-aadf-bd2539ed5a17 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:35 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:52:35 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:35 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ed42b2fa-d212-468f-9432-c5d6cc5dd3a7 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d.61dcc9c9-0c28-4f90-9e8f-eea620fede52" returned: 0 in 0.246s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ed42b2fa-d212-468f-9432-c5d6cc5dd3a7 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:36 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3be68c86-c879-434e-aadf-bd2539ed5a17 tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.279s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-3be68c86-c879-434e-aadf-bd2539ed5a17 tempest-ProjectReaderTests-1534806197 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:52:36 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3be68c86-c879-434e-aadf-bd2539ed5a17 tempest-ProjectReaderTests-1534806197 None] Deleted volume successfully. Sep 05 11:52:36 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d.info Sep 05 11:52:36 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-3be68c86-c879-434e-aadf-bd2539ed5a17 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-b5216275-7716-4ca5-807a-9a0f1be15486-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:36 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ed42b2fa-d212-468f-9432-c5d6cc5dd3a7 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d.info" returned: 0 in 0.264s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:36 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-ed42b2fa-d212-468f-9432-c5d6cc5dd3a7 tempest-ProjectMemberTests-1275208846 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d.info is being set with open permissions: ugo+rw Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ed42b2fa-d212-468f-9432-c5d6cc5dd3a7 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:36 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d.info Sep 05 11:52:36 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] Flow 'volume_create_manager' (8afd9165-1ea4-4c09-a54a-b61fcd87e923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace33614-1105-459d-980e-c2f7373f21b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace33614-1105-459d-980e-c2f7373f21b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-230168074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1cefec7-c868-4e9b-b877-8a8ed1e73473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19721c63425b45ed9804232ddcf1e000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:52:36Z,use_quota=True,user_id='335cdccede6c4f1eb437e1702bf54a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3ac511-5310-4677-b3ed-85784a2167fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3ac511-5310-4677-b3ed-85784a2167fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:36 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceb07420-94a6-4bec-8932-e3a6aeee7da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceb07420-94a6-4bec-8932-e3a6aeee7da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1cefec7-c868-4e9b-b877-8a8ed1e73473', 'volume_name': 'volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a81299-4cc8-4268-a618-06c24a1cd400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a81299-4cc8-4268-a618-06c24a1cd400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21892cf6-d960-4f5b-967f-bfb8aae34a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:36 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] Volume c1cefec7-c868-4e9b-b877-8a8ed1e73473: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473', 'volume_size': 1} Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ed42b2fa-d212-468f-9432-c5d6cc5dd3a7 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d.info" returned: 0 in 0.282s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ed42b2fa-d212-468f-9432-c5d6cc5dd3a7 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.988s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.018s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-230168074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1cefec7-c868-4e9b-b877-8a8ed1e73473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19721c63425b45ed9804232ddcf1e000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:52:36Z,use_quota=True,user_id='335cdccede6c4f1eb437e1702bf54a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] Creating volume c1cefec7-c868-4e9b-b877-8a8ed1e73473 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:52:36 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:36 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473 1073741824 Sep 05 11:52:36 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:36 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ed42b2fa-d212-468f-9432-c5d6cc5dd3a7 tempest-ProjectMemberTests-1275208846 None] Create snapshot completed successfully Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2c90dff6-c5e4-478d-b71c-b320f039fe05 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-61dcc9c9-0c28-4f90-9e8f-eea620fede52-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2c90dff6-c5e4-478d-b71c-b320f039fe05 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-61dcc9c9-0c28-4f90-9e8f-eea620fede52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2c90dff6-c5e4-478d-b71c-b320f039fe05 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-quobyte-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2c90dff6-c5e4-478d-b71c-b320f039fe05 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2c90dff6-c5e4-478d-b71c-b320f039fe05 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-quobyte-61dcc9c9-0c28-4f90-9e8f-eea620fede52" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2c90dff6-c5e4-478d-b71c-b320f039fe05 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-61dcc9c9-0c28-4f90-9e8f-eea620fede52" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-2c90dff6-c5e4-478d-b71c-b320f039fe05 tempest-ProjectMemberTests-1275208846 None] Deleting offline snapshot 61dcc9c9-0c28-4f90-9e8f-eea620fede52 of volume d7d6912a-d3aa-4605-b832-6c8aba7b2a6d {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-2c90dff6-c5e4-478d-b71c-b320f039fe05 tempest-ProjectMemberTests-1275208846 None] snapshot_file for this snap is: volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d.61dcc9c9-0c28-4f90-9e8f-eea620fede52 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f9979a-4a3d-4f22-8e4c-d4dc7379cd6e]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2c90dff6-c5e4-478d-b71c-b320f039fe05 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d.61dcc9c9-0c28-4f90-9e8f-eea620fede52 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:36 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d.61dcc9c9-0c28-4f90-9e8f-eea620fede52 Sep 05 11:52:36 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:37 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473 1073741824" returned: 0 in 0.442s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:37 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473 Sep 05 11:52:37 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:37 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2c90dff6-c5e4-478d-b71c-b320f039fe05 tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d.61dcc9c9-0c28-4f90-9e8f-eea620fede52" returned: 0 in 0.378s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-2c90dff6-c5e4-478d-b71c-b320f039fe05 tempest-ProjectMemberTests-1275208846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:52:37 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3fef2d-2668-4384-b647-a341f02881a1]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2c90dff6-c5e4-478d-b71c-b320f039fe05 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:37 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d Sep 05 11:52:37 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:37 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473" returned: 0 in 0.248s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:52:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21892cf6-d960-4f5b-967f-bfb8aae34a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03a62386-154d-41f9-b2d3-23c56e1b318f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:37 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] Volume volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473 (c1cefec7-c868-4e9b-b877-8a8ed1e73473): created successfully Sep 05 11:52:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03a62386-154d-41f9-b2d3-23c56e1b318f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:37 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] Flow 'volume_create_manager' (8afd9165-1ea4-4c09-a54a-b61fcd87e923) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:52:37 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-28cae4e5-50f4-435d-9f4e-41dc227b6873 tempest-ProjectReaderTests-1534806197 None] Created volume successfully. Sep 05 11:52:37 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2c90dff6-c5e4-478d-b71c-b320f039fe05 tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d" returned: 0 in 0.375s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2c90dff6-c5e4-478d-b71c-b320f039fe05 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d.61dcc9c9-0c28-4f90-9e8f-eea620fede52 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:37 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d.61dcc9c9-0c28-4f90-9e8f-eea620fede52 Sep 05 11:52:37 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9cc9d287-467e-463d-8075-3b3daec355c7 tempest-ProjectReaderTests-1534806197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9cc9d287-467e-463d-8075-3b3daec355c7 tempest-ProjectReaderTests-1534806197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:37 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-9cc9d287-467e-463d-8075-3b3daec355c7 tempest-ProjectReaderTests-1534806197 None] Creating offline snapshot b04ef371-e624-4b04-bf5f-3198e0002196 of volume c1cefec7-c868-4e9b-b877-8a8ed1e73473 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:52:37 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[21327982-3e85-4d6a-936a-8368cece481f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9cc9d287-467e-463d-8075-3b3daec355c7 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:37 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473 Sep 05 11:52:37 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:37 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2c90dff6-c5e4-478d-b71c-b320f039fe05 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d.61dcc9c9-0c28-4f90-9e8f-eea620fede52" returned: 0 in 0.370s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2c90dff6-c5e4-478d-b71c-b320f039fe05 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d.61dcc9c9-0c28-4f90-9e8f-eea620fede52 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:37 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d.61dcc9c9-0c28-4f90-9e8f-eea620fede52 Sep 05 11:52:37 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:38 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9cc9d287-467e-463d-8075-3b3daec355c7 tempest-ProjectReaderTests-1534806197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473" returned: 0 in 0.393s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9cc9d287-467e-463d-8075-3b3daec355c7 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473.b04ef371-e624-4b04-bf5f-3198e0002196 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:38 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473.b04ef371-e624-4b04-bf5f-3198e0002196 1G Sep 05 11:52:38 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:38 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2c90dff6-c5e4-478d-b71c-b320f039fe05 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d.61dcc9c9-0c28-4f90-9e8f-eea620fede52" returned: 0 in 0.279s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2c90dff6-c5e4-478d-b71c-b320f039fe05 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-61dcc9c9-0c28-4f90-9e8f-eea620fede52" released by "_delete_snapshot" :: held 1.499s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2c90dff6-c5e4-478d-b71c-b320f039fe05 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d" released by "delete_snapshot" :: held 1.522s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:38 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-2c90dff6-c5e4-478d-b71c-b320f039fe05 tempest-ProjectMemberTests-1275208846 None] Created reservations ['45efa382-24c5-4faf-942b-c632827147f4', '2369936d-aa2b-4001-8231-ba0aa037f482', '56c0f62b-75db-4c07-b5db-597456d6a822', 'c1f185e9-c358-4065-b37c-30f7fc00356c'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:52:38 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2c90dff6-c5e4-478d-b71c-b320f039fe05 tempest-ProjectMemberTests-1275208846 None] Delete snapshot completed successfully. Sep 05 11:52:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-2c90dff6-c5e4-478d-b71c-b320f039fe05 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-61dcc9c9-0c28-4f90-9e8f-eea620fede52-delete_snapshot" released by "delete_snapshot" :: held 1.660s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:38 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9cc9d287-467e-463d-8075-3b3daec355c7 tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473.b04ef371-e624-4b04-bf5f-3198e0002196 1G" returned: 0 in 0.419s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9cc9d287-467e-463d-8075-3b3daec355c7 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473.b04ef371-e624-4b04-bf5f-3198e0002196 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:38 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473.b04ef371-e624-4b04-bf5f-3198e0002196 Sep 05 11:52:38 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:38 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9cc9d287-467e-463d-8075-3b3daec355c7 tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473.b04ef371-e624-4b04-bf5f-3198e0002196" returned: 0 in 0.274s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:38 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-9cc9d287-467e-463d-8075-3b3daec355c7 tempest-ProjectReaderTests-1534806197 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473.b04ef371-e624-4b04-bf5f-3198e0002196 is being set with open permissions: ugo+rw Sep 05 11:52:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9cc9d287-467e-463d-8075-3b3daec355c7 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473.b04ef371-e624-4b04-bf5f-3198e0002196 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:38 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473.b04ef371-e624-4b04-bf5f-3198e0002196 Sep 05 11:52:38 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f24578d1-2d6b-4404-b70a-d00cb91f0e37 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f24578d1-2d6b-4404-b70a-d00cb91f0e37 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f24578d1-2d6b-4404-b70a-d00cb91f0e37 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-quobyte-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f24578d1-2d6b-4404-b70a-d00cb91f0e37 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d" acquired by "delete_volume" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:38 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81d7a17-b07d-40dc-b1ab-4908e93dfa35]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f24578d1-2d6b-4404-b70a-d00cb91f0e37 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:39 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9cc9d287-467e-463d-8075-3b3daec355c7 tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473.b04ef371-e624-4b04-bf5f-3198e0002196" returned: 0 in 0.258s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9cc9d287-467e-463d-8075-3b3daec355c7 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:39 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473.info Sep 05 11:52:39 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:39 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d Sep 05 11:52:39 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:39 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9cc9d287-467e-463d-8075-3b3daec355c7 tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473.info" returned: 0 in 0.252s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:39 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-9cc9d287-467e-463d-8075-3b3daec355c7 tempest-ProjectReaderTests-1534806197 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473.info is being set with open permissions: ugo+rw Sep 05 11:52:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9cc9d287-467e-463d-8075-3b3daec355c7 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:39 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473.info Sep 05 11:52:39 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:39 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f24578d1-2d6b-4404-b70a-d00cb91f0e37 tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d" returned: 0 in 0.367s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f24578d1-2d6b-4404-b70a-d00cb91f0e37 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:39 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d Sep 05 11:52:39 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:39 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9cc9d287-467e-463d-8075-3b3daec355c7 tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473.info" returned: 0 in 0.244s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9cc9d287-467e-463d-8075-3b3daec355c7 tempest-ProjectReaderTests-1534806197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.914s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:39 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:39 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-9cc9d287-467e-463d-8075-3b3daec355c7 tempest-ProjectReaderTests-1534806197 None] Create snapshot completed successfully Sep 05 11:52:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f24578d1-2d6b-4404-b70a-d00cb91f0e37 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d" returned: 0 in 0.249s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f24578d1-2d6b-4404-b70a-d00cb91f0e37 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d" released by "delete_volume" :: held 0.673s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:39 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-f24578d1-2d6b-4404-b70a-d00cb91f0e37 tempest-ProjectMemberTests-1275208846 None] Created reservations ['ab206a25-071a-4ad0-a85b-bb9d42b865b0', '99566597-a93e-4a90-8151-20888a7013d4', '974b2b06-99bc-43f1-969c-495df4ce231f', 'b7c5b8e0-bb25-472b-9f5b-90595b57dcdd'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:52:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f24578d1-2d6b-4404-b70a-d00cb91f0e37 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f24578d1-2d6b-4404-b70a-d00cb91f0e37 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f24578d1-2d6b-4404-b70a-d00cb91f0e37 tempest-ProjectMemberTests-1275208846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-f24578d1-2d6b-4404-b70a-d00cb91f0e37 tempest-ProjectMemberTests-1275208846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-f24578d1-2d6b-4404-b70a-d00cb91f0e37 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f24578d1-2d6b-4404-b70a-d00cb91f0e37 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:39 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:52:39 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-16a0b264-68a9-4d83-9ea2-93605ae6f3d7 tempest-ProjectReaderTests-1534806197 None] Acquiring lock "cinder-b04ef371-e624-4b04-bf5f-3198e0002196-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-16a0b264-68a9-4d83-9ea2-93605ae6f3d7 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-b04ef371-e624-4b04-bf5f-3198e0002196-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-16a0b264-68a9-4d83-9ea2-93605ae6f3d7 tempest-ProjectReaderTests-1534806197 None] Acquiring lock "cinder-quobyte-c1cefec7-c868-4e9b-b877-8a8ed1e73473" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-16a0b264-68a9-4d83-9ea2-93605ae6f3d7 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-quobyte-c1cefec7-c868-4e9b-b877-8a8ed1e73473" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-16a0b264-68a9-4d83-9ea2-93605ae6f3d7 tempest-ProjectReaderTests-1534806197 None] Acquiring lock "cinder-quobyte-b04ef371-e624-4b04-bf5f-3198e0002196" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:39 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-16a0b264-68a9-4d83-9ea2-93605ae6f3d7 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-quobyte-b04ef371-e624-4b04-bf5f-3198e0002196" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-16a0b264-68a9-4d83-9ea2-93605ae6f3d7 tempest-ProjectReaderTests-1534806197 None] Deleting offline snapshot b04ef371-e624-4b04-bf5f-3198e0002196 of volume c1cefec7-c868-4e9b-b877-8a8ed1e73473 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:52:39 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-16a0b264-68a9-4d83-9ea2-93605ae6f3d7 tempest-ProjectReaderTests-1534806197 None] snapshot_file for this snap is: volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473.b04ef371-e624-4b04-bf5f-3198e0002196 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:52:39 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94ee281-402a-4f53-a4ab-6d462a1b7fdb]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:39 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-16a0b264-68a9-4d83-9ea2-93605ae6f3d7 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473.b04ef371-e624-4b04-bf5f-3198e0002196 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:40 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:40 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473.b04ef371-e624-4b04-bf5f-3198e0002196 Sep 05 11:52:40 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-f24578d1-2d6b-4404-b70a-d00cb91f0e37 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.264s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:40 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-f24578d1-2d6b-4404-b70a-d00cb91f0e37 tempest-ProjectMemberTests-1275208846 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:52:40 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-f24578d1-2d6b-4404-b70a-d00cb91f0e37 tempest-ProjectMemberTests-1275208846 None] Deleted volume successfully. Sep 05 11:52:40 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-f24578d1-2d6b-4404-b70a-d00cb91f0e37 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-d7d6912a-d3aa-4605-b832-6c8aba7b2a6d-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:40 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-16a0b264-68a9-4d83-9ea2-93605ae6f3d7 tempest-ProjectReaderTests-1534806197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473.b04ef371-e624-4b04-bf5f-3198e0002196" returned: 0 in 0.366s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-16a0b264-68a9-4d83-9ea2-93605ae6f3d7 tempest-ProjectReaderTests-1534806197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:52:40 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d45e91-c8a5-472d-9b83-4431d50090ea]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-16a0b264-68a9-4d83-9ea2-93605ae6f3d7 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:40 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473 Sep 05 11:52:40 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:40 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:52:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] Flow 'volume_create_manager' (a943ccac-a98c-4635-9f61-0a35aec4c5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:52:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c6f9d67-04a3-4d51-81cf-519db66bc818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c6f9d67-04a3-4d51-81cf-519db66bc818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-823024266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c018fff-eba6-495e-b474-09a56d815328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47eb7f5800ca42a8aac1df1019b50492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:52:40Z,use_quota=True,user_id='4498bbe7acb84612bf0e189659c0581e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5564b8-247c-443a-9f24-a621ccfff2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5564b8-247c-443a-9f24-a621ccfff2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (352b62e5-06f3-4146-bbac-320e9c6029da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (352b62e5-06f3-4146-bbac-320e9c6029da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c018fff-eba6-495e-b474-09a56d815328', 'volume_name': 'volume-8c018fff-eba6-495e-b474-09a56d815328', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c4ddb9e-1e02-448f-84e1-067e24aefe2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c4ddb9e-1e02-448f-84e1-067e24aefe2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:40 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b41fce93-e572-4430-8f95-4c341c2401fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:40 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] Volume 8c018fff-eba6-495e-b474-09a56d815328: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c018fff-eba6-495e-b474-09a56d815328', 'volume_size': 1} Sep 05 11:52:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-823024266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c018fff-eba6-495e-b474-09a56d815328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47eb7f5800ca42a8aac1df1019b50492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:52:40Z,use_quota=True,user_id='4498bbe7acb84612bf0e189659c0581e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:52:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] Creating volume 8c018fff-eba6-495e-b474-09a56d815328 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:52:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:40 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:52:40 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:52:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:40 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328 1073741824 Sep 05 11:52:40 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:40 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-16a0b264-68a9-4d83-9ea2-93605ae6f3d7 tempest-ProjectReaderTests-1534806197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473" returned: 0 in 0.375s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:40 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-16a0b264-68a9-4d83-9ea2-93605ae6f3d7 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473.b04ef371-e624-4b04-bf5f-3198e0002196 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:40 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473.b04ef371-e624-4b04-bf5f-3198e0002196 Sep 05 11:52:40 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:41 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-16a0b264-68a9-4d83-9ea2-93605ae6f3d7 tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473.b04ef371-e624-4b04-bf5f-3198e0002196" returned: 0 in 0.351s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-16a0b264-68a9-4d83-9ea2-93605ae6f3d7 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473.b04ef371-e624-4b04-bf5f-3198e0002196 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:41 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328 1073741824" returned: 0 in 0.445s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:41 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473.b04ef371-e624-4b04-bf5f-3198e0002196 Sep 05 11:52:41 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:41 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328 Sep 05 11:52:41 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:41 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-16a0b264-68a9-4d83-9ea2-93605ae6f3d7 tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473.b04ef371-e624-4b04-bf5f-3198e0002196" returned: 0 in 0.246s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-16a0b264-68a9-4d83-9ea2-93605ae6f3d7 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-quobyte-b04ef371-e624-4b04-bf5f-3198e0002196" released by "_delete_snapshot" :: held 1.432s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-16a0b264-68a9-4d83-9ea2-93605ae6f3d7 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-quobyte-c1cefec7-c868-4e9b-b877-8a8ed1e73473" released by "delete_snapshot" :: held 1.456s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:41 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328" returned: 0 in 0.246s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:52:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b41fce93-e572-4430-8f95-4c341c2401fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c018fff-eba6-495e-b474-09a56d815328', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3412dd9-530c-4d0a-8d76-6bc323580f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:41 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] Volume volume-8c018fff-eba6-495e-b474-09a56d815328 (8c018fff-eba6-495e-b474-09a56d815328): created successfully Sep 05 11:52:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3412dd9-530c-4d0a-8d76-6bc323580f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:41 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] Flow 'volume_create_manager' (a943ccac-a98c-4635-9f61-0a35aec4c5a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:52:41 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a031f26b-736c-4ee2-8e24-ba21f882ecaa tempest-ProjectMemberTests-1275208846 None] Created volume successfully. Sep 05 11:52:41 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-16a0b264-68a9-4d83-9ea2-93605ae6f3d7 tempest-ProjectReaderTests-1534806197 None] Created reservations ['32f0cc4d-6ea3-40e4-a52c-fdaef7ea4b10', 'c4654e0a-242c-49fc-bd22-c5de85d3c9bb', 'cf002a80-5c9a-4651-991b-2737362c46f8', 'c0201a3e-4f7f-4aea-b651-45da88bedc96'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:52:41 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-16a0b264-68a9-4d83-9ea2-93605ae6f3d7 tempest-ProjectReaderTests-1534806197 None] Delete snapshot completed successfully. Sep 05 11:52:41 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-16a0b264-68a9-4d83-9ea2-93605ae6f3d7 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-b04ef371-e624-4b04-bf5f-3198e0002196-delete_snapshot" released by "delete_snapshot" :: held 1.622s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d6dd0860-c2ce-465c-a684-5b35b4cebc54 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d6dd0860-c2ce-465c-a684-5b35b4cebc54 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:41 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-d6dd0860-c2ce-465c-a684-5b35b4cebc54 tempest-ProjectMemberTests-1275208846 None] Creating offline snapshot 1370db1d-63c7-49fb-b6f3-c7d115368b38 of volume 8c018fff-eba6-495e-b474-09a56d815328 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:52:41 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e9421b-dd5b-4eb6-809d-3ffd010f5d2f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:41 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d6dd0860-c2ce-465c-a684-5b35b4cebc54 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8f9a221b-47e7-4fbb-9241-2a2260b30103 tempest-ProjectReaderTests-1534806197 None] Acquiring lock "cinder-c1cefec7-c868-4e9b-b877-8a8ed1e73473-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8f9a221b-47e7-4fbb-9241-2a2260b30103 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-c1cefec7-c868-4e9b-b877-8a8ed1e73473-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8f9a221b-47e7-4fbb-9241-2a2260b30103 tempest-ProjectReaderTests-1534806197 None] Acquiring lock "cinder-quobyte-c1cefec7-c868-4e9b-b877-8a8ed1e73473" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8f9a221b-47e7-4fbb-9241-2a2260b30103 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-quobyte-c1cefec7-c868-4e9b-b877-8a8ed1e73473" acquired by "delete_volume" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:42 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328 Sep 05 11:52:42 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:42 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9b8841-c7fc-4e77-af08-990e69d6ae5e]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8f9a221b-47e7-4fbb-9241-2a2260b30103 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:42 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473 Sep 05 11:52:42 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:42 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d6dd0860-c2ce-465c-a684-5b35b4cebc54 tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328" returned: 0 in 0.375s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d6dd0860-c2ce-465c-a684-5b35b4cebc54 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328.1370db1d-63c7-49fb-b6f3-c7d115368b38 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:42 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328.1370db1d-63c7-49fb-b6f3-c7d115368b38 1G Sep 05 11:52:42 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:42 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8f9a221b-47e7-4fbb-9241-2a2260b30103 tempest-ProjectReaderTests-1534806197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473" returned: 0 in 0.374s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8f9a221b-47e7-4fbb-9241-2a2260b30103 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:42 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473 Sep 05 11:52:42 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:42 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d6dd0860-c2ce-465c-a684-5b35b4cebc54 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328.1370db1d-63c7-49fb-b6f3-c7d115368b38 1G" returned: 0 in 0.416s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d6dd0860-c2ce-465c-a684-5b35b4cebc54 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c018fff-eba6-495e-b474-09a56d815328 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328.1370db1d-63c7-49fb-b6f3-c7d115368b38 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:42 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8f9a221b-47e7-4fbb-9241-2a2260b30103 tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-c1cefec7-c868-4e9b-b877-8a8ed1e73473" returned: 0 in 0.295s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:42 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c018fff-eba6-495e-b474-09a56d815328 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328.1370db1d-63c7-49fb-b6f3-c7d115368b38 Sep 05 11:52:42 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:42 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8f9a221b-47e7-4fbb-9241-2a2260b30103 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-quobyte-c1cefec7-c868-4e9b-b877-8a8ed1e73473" released by "delete_volume" :: held 0.728s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:42 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-8f9a221b-47e7-4fbb-9241-2a2260b30103 tempest-ProjectReaderTests-1534806197 None] Created reservations ['51fd519a-0abb-4e23-97f6-abc93d3b895f', '49225578-7fdf-4e25-84bf-5498f96037f4', '2ac29877-e6ae-44d3-8537-3f53fbafa29f', '8620e43a-fd52-49b7-be42-b103821194d3'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:52:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8f9a221b-47e7-4fbb-9241-2a2260b30103 tempest-ProjectReaderTests-1534806197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8f9a221b-47e7-4fbb-9241-2a2260b30103 tempest-ProjectReaderTests-1534806197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8f9a221b-47e7-4fbb-9241-2a2260b30103 tempest-ProjectReaderTests-1534806197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:42 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-8f9a221b-47e7-4fbb-9241-2a2260b30103 tempest-ProjectReaderTests-1534806197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-8f9a221b-47e7-4fbb-9241-2a2260b30103 tempest-ProjectReaderTests-1534806197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:42 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8f9a221b-47e7-4fbb-9241-2a2260b30103 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:42 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:52:42 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:43 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d6dd0860-c2ce-465c-a684-5b35b4cebc54 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c018fff-eba6-495e-b474-09a56d815328 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328.1370db1d-63c7-49fb-b6f3-c7d115368b38" returned: 0 in 0.303s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:43 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-d6dd0860-c2ce-465c-a684-5b35b4cebc54 tempest-ProjectMemberTests-1275208846 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328.1370db1d-63c7-49fb-b6f3-c7d115368b38 is being set with open permissions: ugo+rw Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d6dd0860-c2ce-465c-a684-5b35b4cebc54 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328.1370db1d-63c7-49fb-b6f3-c7d115368b38 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:43 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328.1370db1d-63c7-49fb-b6f3-c7d115368b38 Sep 05 11:52:43 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:43 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-8f9a221b-47e7-4fbb-9241-2a2260b30103 tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.260s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-8f9a221b-47e7-4fbb-9241-2a2260b30103 tempest-ProjectReaderTests-1534806197 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:52:43 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-8f9a221b-47e7-4fbb-9241-2a2260b30103 tempest-ProjectReaderTests-1534806197 None] Deleted volume successfully. Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-8f9a221b-47e7-4fbb-9241-2a2260b30103 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-c1cefec7-c868-4e9b-b877-8a8ed1e73473-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:43 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d6dd0860-c2ce-465c-a684-5b35b4cebc54 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328.1370db1d-63c7-49fb-b6f3-c7d115368b38" returned: 0 in 0.263s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d6dd0860-c2ce-465c-a684-5b35b4cebc54 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:43 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328.info Sep 05 11:52:43 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:52:43 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] Flow 'volume_create_manager' (41769355-73de-4776-9425-782f73f6dc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7d987ca-67bf-4759-88d7-ecd76b93fa29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d6dd0860-c2ce-465c-a684-5b35b4cebc54 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328.info" returned: 0 in 0.323s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:43 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-d6dd0860-c2ce-465c-a684-5b35b4cebc54 tempest-ProjectMemberTests-1275208846 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328.info is being set with open permissions: ugo+rw Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d6dd0860-c2ce-465c-a684-5b35b4cebc54 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7d987ca-67bf-4759-88d7-ecd76b93fa29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1028909622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2dec213-b440-4c13-a0c9-b3e71070893f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19721c63425b45ed9804232ddcf1e000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:52:44Z,use_quota=True,user_id='335cdccede6c4f1eb437e1702bf54a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:43 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328.info Sep 05 11:52:43 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113cc17c-a7ad-40f8-b6fb-e807d91be9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113cc17c-a7ad-40f8-b6fb-e807d91be9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8cd6922-b0dd-4225-b012-9825c38ba77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8cd6922-b0dd-4225-b012-9825c38ba77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2dec213-b440-4c13-a0c9-b3e71070893f', 'volume_name': 'volume-d2dec213-b440-4c13-a0c9-b3e71070893f', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd396fc0-1350-42e3-882f-e189c97a3433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd396fc0-1350-42e3-882f-e189c97a3433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc30e4a-d586-488b-af8a-8812f29a6cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:43 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] Volume d2dec213-b440-4c13-a0c9-b3e71070893f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2dec213-b440-4c13-a0c9-b3e71070893f', 'volume_size': 1} Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:43 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d6dd0860-c2ce-465c-a684-5b35b4cebc54 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328.info" returned: 0 in 0.246s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d6dd0860-c2ce-465c-a684-5b35b4cebc54 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.200s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1028909622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2dec213-b440-4c13-a0c9-b3e71070893f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19721c63425b45ed9804232ddcf1e000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:52:44Z,use_quota=True,user_id='335cdccede6c4f1eb437e1702bf54a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] Creating volume d2dec213-b440-4c13-a0c9-b3e71070893f {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:52:43 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:52:43 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:43 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f 1073741824 Sep 05 11:52:43 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:43 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d6dd0860-c2ce-465c-a684-5b35b4cebc54 tempest-ProjectMemberTests-1275208846 None] Create snapshot completed successfully Sep 05 11:52:44 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f 1073741824" returned: 0 in 0.406s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:44 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f Sep 05 11:52:44 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:44 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f" returned: 0 in 0.242s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:44 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:52:44 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc30e4a-d586-488b-af8a-8812f29a6cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2dec213-b440-4c13-a0c9-b3e71070893f', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0508740-0359-49bb-9141-f4a987534a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:44 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] Volume volume-d2dec213-b440-4c13-a0c9-b3e71070893f (d2dec213-b440-4c13-a0c9-b3e71070893f): created successfully Sep 05 11:52:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0508740-0359-49bb-9141-f4a987534a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:44 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] Flow 'volume_create_manager' (41769355-73de-4776-9425-782f73f6dc46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:52:44 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-77edcca0-f537-42ab-83e2-7b8d94a58fb7 tempest-ProjectReaderTests-1534806197 None] Created volume successfully. Sep 05 11:52:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fa886ce9-0619-44bf-9be5-dcd47ae061ba tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-1370db1d-63c7-49fb-b6f3-c7d115368b38-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fa886ce9-0619-44bf-9be5-dcd47ae061ba tempest-ProjectMemberTests-1275208846 None] Lock "cinder-1370db1d-63c7-49fb-b6f3-c7d115368b38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fa886ce9-0619-44bf-9be5-dcd47ae061ba tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-quobyte-8c018fff-eba6-495e-b474-09a56d815328" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fa886ce9-0619-44bf-9be5-dcd47ae061ba tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-8c018fff-eba6-495e-b474-09a56d815328" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fa886ce9-0619-44bf-9be5-dcd47ae061ba tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-quobyte-1370db1d-63c7-49fb-b6f3-c7d115368b38" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:45 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fa886ce9-0619-44bf-9be5-dcd47ae061ba tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-1370db1d-63c7-49fb-b6f3-c7d115368b38" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-fa886ce9-0619-44bf-9be5-dcd47ae061ba tempest-ProjectMemberTests-1275208846 None] Deleting offline snapshot 1370db1d-63c7-49fb-b6f3-c7d115368b38 of volume 8c018fff-eba6-495e-b474-09a56d815328 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:52:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-fa886ce9-0619-44bf-9be5-dcd47ae061ba tempest-ProjectMemberTests-1275208846 None] snapshot_file for this snap is: volume-8c018fff-eba6-495e-b474-09a56d815328.1370db1d-63c7-49fb-b6f3-c7d115368b38 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:52:45 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d392f51-63f8-4f80-8c27-e9fec230071a]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fa886ce9-0619-44bf-9be5-dcd47ae061ba tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328.1370db1d-63c7-49fb-b6f3-c7d115368b38 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:45 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328.1370db1d-63c7-49fb-b6f3-c7d115368b38 Sep 05 11:52:45 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:45 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fa886ce9-0619-44bf-9be5-dcd47ae061ba tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328.1370db1d-63c7-49fb-b6f3-c7d115368b38" returned: 0 in 0.365s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-fa886ce9-0619-44bf-9be5-dcd47ae061ba tempest-ProjectMemberTests-1275208846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c018fff-eba6-495e-b474-09a56d815328(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:52:45 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78d0527-898e-4fd0-99d7-5081c4b5f9d7]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fa886ce9-0619-44bf-9be5-dcd47ae061ba tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:45 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328 Sep 05 11:52:45 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c77b0895-a6c8-45a2-b086-f85eb702f50a tempest-ProjectReaderTests-1534806197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c77b0895-a6c8-45a2-b086-f85eb702f50a tempest-ProjectReaderTests-1534806197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:45 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-c77b0895-a6c8-45a2-b086-f85eb702f50a tempest-ProjectReaderTests-1534806197 None] Creating offline snapshot 7d8f1dc7-fd3c-4050-8027-f1f7c90f1aa1 of volume d2dec213-b440-4c13-a0c9-b3e71070893f {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:52:45 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b9d0cf-9561-40e3-9f47-9f546d21680f]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c77b0895-a6c8-45a2-b086-f85eb702f50a tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:45 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fa886ce9-0619-44bf-9be5-dcd47ae061ba tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328" returned: 0 in 0.393s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:45 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fa886ce9-0619-44bf-9be5-dcd47ae061ba tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328.1370db1d-63c7-49fb-b6f3-c7d115368b38 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:45 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328.1370db1d-63c7-49fb-b6f3-c7d115368b38 Sep 05 11:52:45 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:46 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f Sep 05 11:52:46 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:46 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:46 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c77b0895-a6c8-45a2-b086-f85eb702f50a tempest-ProjectReaderTests-1534806197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f" returned: 0 in 0.371s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c77b0895-a6c8-45a2-b086-f85eb702f50a tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f.7d8f1dc7-fd3c-4050-8027-f1f7c90f1aa1 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fa886ce9-0619-44bf-9be5-dcd47ae061ba tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328.1370db1d-63c7-49fb-b6f3-c7d115368b38" returned: 0 in 0.360s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fa886ce9-0619-44bf-9be5-dcd47ae061ba tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328.1370db1d-63c7-49fb-b6f3-c7d115368b38 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:46 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f.7d8f1dc7-fd3c-4050-8027-f1f7c90f1aa1 1G Sep 05 11:52:46 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:46 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328.1370db1d-63c7-49fb-b6f3-c7d115368b38 Sep 05 11:52:46 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:46 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-fa886ce9-0619-44bf-9be5-dcd47ae061ba tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328.1370db1d-63c7-49fb-b6f3-c7d115368b38" returned: 0 in 0.260s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fa886ce9-0619-44bf-9be5-dcd47ae061ba tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-1370db1d-63c7-49fb-b6f3-c7d115368b38" released by "_delete_snapshot" :: held 1.483s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fa886ce9-0619-44bf-9be5-dcd47ae061ba tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-8c018fff-eba6-495e-b474-09a56d815328" released by "delete_snapshot" :: held 1.506s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:46 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-fa886ce9-0619-44bf-9be5-dcd47ae061ba tempest-ProjectMemberTests-1275208846 None] Created reservations ['9d9b5aa2-ccc7-4aa5-ac34-0e2b05981810', '985593aa-1090-40ea-b90b-e9cc919bd4b6', 'b3c11b2a-c490-4c8a-9b50-246dcd848e7f', '7127cc1e-92c1-4ce8-aba5-e081d8de5e9d'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:52:46 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c77b0895-a6c8-45a2-b086-f85eb702f50a tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f.7d8f1dc7-fd3c-4050-8027-f1f7c90f1aa1 1G" returned: 0 in 0.418s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c77b0895-a6c8-45a2-b086-f85eb702f50a tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2dec213-b440-4c13-a0c9-b3e71070893f -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f.7d8f1dc7-fd3c-4050-8027-f1f7c90f1aa1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:46 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-fa886ce9-0619-44bf-9be5-dcd47ae061ba tempest-ProjectMemberTests-1275208846 None] Delete snapshot completed successfully. Sep 05 11:52:46 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2dec213-b440-4c13-a0c9-b3e71070893f -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f.7d8f1dc7-fd3c-4050-8027-f1f7c90f1aa1 Sep 05 11:52:46 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:46 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-fa886ce9-0619-44bf-9be5-dcd47ae061ba tempest-ProjectMemberTests-1275208846 None] Lock "cinder-1370db1d-63c7-49fb-b6f3-c7d115368b38-delete_snapshot" released by "delete_snapshot" :: held 1.658s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:46 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c77b0895-a6c8-45a2-b086-f85eb702f50a tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2dec213-b440-4c13-a0c9-b3e71070893f -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f.7d8f1dc7-fd3c-4050-8027-f1f7c90f1aa1" returned: 0 in 0.282s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:46 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-c77b0895-a6c8-45a2-b086-f85eb702f50a tempest-ProjectReaderTests-1534806197 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f.7d8f1dc7-fd3c-4050-8027-f1f7c90f1aa1 is being set with open permissions: ugo+rw Sep 05 11:52:46 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c77b0895-a6c8-45a2-b086-f85eb702f50a tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f.7d8f1dc7-fd3c-4050-8027-f1f7c90f1aa1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:47 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f.7d8f1dc7-fd3c-4050-8027-f1f7c90f1aa1 Sep 05 11:52:47 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:47 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c77b0895-a6c8-45a2-b086-f85eb702f50a tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f.7d8f1dc7-fd3c-4050-8027-f1f7c90f1aa1" returned: 0 in 0.237s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c77b0895-a6c8-45a2-b086-f85eb702f50a tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:47 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f.info Sep 05 11:52:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ac2d342c-ce16-4c99-a97e-853628f4cafd tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-8c018fff-eba6-495e-b474-09a56d815328-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:47 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ac2d342c-ce16-4c99-a97e-853628f4cafd tempest-ProjectMemberTests-1275208846 None] Lock "cinder-8c018fff-eba6-495e-b474-09a56d815328-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ac2d342c-ce16-4c99-a97e-853628f4cafd tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-quobyte-8c018fff-eba6-495e-b474-09a56d815328" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ac2d342c-ce16-4c99-a97e-853628f4cafd tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-8c018fff-eba6-495e-b474-09a56d815328" acquired by "delete_volume" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:47 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad44867e-988c-4433-9ad3-1f9babdf9a31]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ac2d342c-ce16-4c99-a97e-853628f4cafd tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:47 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328 Sep 05 11:52:47 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:47 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c77b0895-a6c8-45a2-b086-f85eb702f50a tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f.info" returned: 0 in 0.259s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:47 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-c77b0895-a6c8-45a2-b086-f85eb702f50a tempest-ProjectReaderTests-1534806197 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f.info is being set with open permissions: ugo+rw Sep 05 11:52:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c77b0895-a6c8-45a2-b086-f85eb702f50a tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:47 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f.info Sep 05 11:52:47 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:47 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ac2d342c-ce16-4c99-a97e-853628f4cafd tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328" returned: 0 in 0.372s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ac2d342c-ce16-4c99-a97e-853628f4cafd tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:47 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c77b0895-a6c8-45a2-b086-f85eb702f50a tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f.info" returned: 0 in 0.262s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:47 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328 Sep 05 11:52:47 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:47 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c77b0895-a6c8-45a2-b086-f85eb702f50a tempest-ProjectReaderTests-1534806197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.909s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:47 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c77b0895-a6c8-45a2-b086-f85eb702f50a tempest-ProjectReaderTests-1534806197 None] Create snapshot completed successfully Sep 05 11:52:47 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d0162b79-e5c7-4c71-af45-7f36f367035a tempest-ProjectReaderTests-1534806197 None] Acquiring lock "cinder-7d8f1dc7-fd3c-4050-8027-f1f7c90f1aa1-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:48 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d0162b79-e5c7-4c71-af45-7f36f367035a tempest-ProjectReaderTests-1534806197 None] Lock "cinder-7d8f1dc7-fd3c-4050-8027-f1f7c90f1aa1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d0162b79-e5c7-4c71-af45-7f36f367035a tempest-ProjectReaderTests-1534806197 None] Acquiring lock "cinder-quobyte-d2dec213-b440-4c13-a0c9-b3e71070893f" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ac2d342c-ce16-4c99-a97e-853628f4cafd tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8c018fff-eba6-495e-b474-09a56d815328" returned: 0 in 0.264s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ac2d342c-ce16-4c99-a97e-853628f4cafd tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-8c018fff-eba6-495e-b474-09a56d815328" released by "delete_volume" :: held 0.700s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d0162b79-e5c7-4c71-af45-7f36f367035a tempest-ProjectReaderTests-1534806197 None] Lock "cinder-quobyte-d2dec213-b440-4c13-a0c9-b3e71070893f" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d0162b79-e5c7-4c71-af45-7f36f367035a tempest-ProjectReaderTests-1534806197 None] Acquiring lock "cinder-quobyte-7d8f1dc7-fd3c-4050-8027-f1f7c90f1aa1" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d0162b79-e5c7-4c71-af45-7f36f367035a tempest-ProjectReaderTests-1534806197 None] Lock "cinder-quobyte-7d8f1dc7-fd3c-4050-8027-f1f7c90f1aa1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-d0162b79-e5c7-4c71-af45-7f36f367035a tempest-ProjectReaderTests-1534806197 None] Deleting offline snapshot 7d8f1dc7-fd3c-4050-8027-f1f7c90f1aa1 of volume d2dec213-b440-4c13-a0c9-b3e71070893f {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:52:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-d0162b79-e5c7-4c71-af45-7f36f367035a tempest-ProjectReaderTests-1534806197 None] snapshot_file for this snap is: volume-d2dec213-b440-4c13-a0c9-b3e71070893f.7d8f1dc7-fd3c-4050-8027-f1f7c90f1aa1 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:52:48 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[735c3e9a-b6b6-496c-88e9-93f5da84240b]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0162b79-e5c7-4c71-af45-7f36f367035a tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f.7d8f1dc7-fd3c-4050-8027-f1f7c90f1aa1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:48 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-ac2d342c-ce16-4c99-a97e-853628f4cafd tempest-ProjectMemberTests-1275208846 None] Created reservations ['2c768679-7627-4915-9992-a7998d682592', '47813c4d-c0e8-45c2-927b-802cc9d7674f', 'e8a9e9f2-a3af-47b4-8471-f05c49009376', '3fcd7616-ffda-4d02-af2f-fa944244b756'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:52:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ac2d342c-ce16-4c99-a97e-853628f4cafd tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ac2d342c-ce16-4c99-a97e-853628f4cafd tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ac2d342c-ce16-4c99-a97e-853628f4cafd tempest-ProjectMemberTests-1275208846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-ac2d342c-ce16-4c99-a97e-853628f4cafd tempest-ProjectMemberTests-1275208846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-ac2d342c-ce16-4c99-a97e-853628f4cafd tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ac2d342c-ce16-4c99-a97e-853628f4cafd tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:48 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f.7d8f1dc7-fd3c-4050-8027-f1f7c90f1aa1 Sep 05 11:52:48 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:48 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:52:48 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:48 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-ac2d342c-ce16-4c99-a97e-853628f4cafd tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.257s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:48 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-ac2d342c-ce16-4c99-a97e-853628f4cafd tempest-ProjectMemberTests-1275208846 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:52:48 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-ac2d342c-ce16-4c99-a97e-853628f4cafd tempest-ProjectMemberTests-1275208846 None] Deleted volume successfully. Sep 05 11:52:48 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0162b79-e5c7-4c71-af45-7f36f367035a tempest-ProjectReaderTests-1534806197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f.7d8f1dc7-fd3c-4050-8027-f1f7c90f1aa1" returned: 0 in 0.376s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:48 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-d0162b79-e5c7-4c71-af45-7f36f367035a tempest-ProjectReaderTests-1534806197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2dec213-b440-4c13-a0c9-b3e71070893f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:52:48 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[790bfe95-7f9e-4985-957c-47ccc35ed2ca]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0162b79-e5c7-4c71-af45-7f36f367035a tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:48 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-ac2d342c-ce16-4c99-a97e-853628f4cafd tempest-ProjectMemberTests-1275208846 None] Lock "cinder-8c018fff-eba6-495e-b474-09a56d815328-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:48 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f Sep 05 11:52:48 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:48 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0162b79-e5c7-4c71-af45-7f36f367035a tempest-ProjectReaderTests-1534806197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f" returned: 0 in 0.382s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:48 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0162b79-e5c7-4c71-af45-7f36f367035a tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f.7d8f1dc7-fd3c-4050-8027-f1f7c90f1aa1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:48 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f.7d8f1dc7-fd3c-4050-8027-f1f7c90f1aa1 Sep 05 11:52:48 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:48 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:52:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] Flow 'volume_create_manager' (3706092a-7775-4b1e-a3ba-e15b2942db99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:52:48 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a416daf7-df6a-4a70-a5f1-677ae06bbfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a416daf7-df6a-4a70-a5f1-677ae06bbfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1641226916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b123c56-7e59-487a-bee0-b2cffafeae1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47eb7f5800ca42a8aac1df1019b50492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:52:49Z,use_quota=True,user_id='4498bbe7acb84612bf0e189659c0581e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a0b772f-c7de-45d6-a1f1-27290a219582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a0b772f-c7de-45d6-a1f1-27290a219582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39a71480-9c8e-4154-9d6f-a6a6d8c7524f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39a71480-9c8e-4154-9d6f-a6a6d8c7524f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b123c56-7e59-487a-bee0-b2cffafeae1d', 'volume_name': 'volume-2b123c56-7e59-487a-bee0-b2cffafeae1d', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6a5ede-aab0-49e9-a5fa-064d8f0eb839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6a5ede-aab0-49e9-a5fa-064d8f0eb839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5d3322-0a32-460d-9005-1af5e6af9ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:49 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] Volume 2b123c56-7e59-487a-bee0-b2cffafeae1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b123c56-7e59-487a-bee0-b2cffafeae1d', 'volume_size': 1} Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1641226916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b123c56-7e59-487a-bee0-b2cffafeae1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47eb7f5800ca42a8aac1df1019b50492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:52:49Z,use_quota=True,user_id='4498bbe7acb84612bf0e189659c0581e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] Creating volume 2b123c56-7e59-487a-bee0-b2cffafeae1d {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:52:49 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:49 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d 1073741824 Sep 05 11:52:49 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:49 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0162b79-e5c7-4c71-af45-7f36f367035a tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f.7d8f1dc7-fd3c-4050-8027-f1f7c90f1aa1" returned: 0 in 0.337s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0162b79-e5c7-4c71-af45-7f36f367035a tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f.7d8f1dc7-fd3c-4050-8027-f1f7c90f1aa1 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:49 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f.7d8f1dc7-fd3c-4050-8027-f1f7c90f1aa1 Sep 05 11:52:49 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:49 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d 1073741824" returned: 0 in 0.421s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:49 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d0162b79-e5c7-4c71-af45-7f36f367035a tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f.7d8f1dc7-fd3c-4050-8027-f1f7c90f1aa1" returned: 0 in 0.259s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d0162b79-e5c7-4c71-af45-7f36f367035a tempest-ProjectReaderTests-1534806197 None] Lock "cinder-quobyte-7d8f1dc7-fd3c-4050-8027-f1f7c90f1aa1" released by "_delete_snapshot" :: held 1.461s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d0162b79-e5c7-4c71-af45-7f36f367035a tempest-ProjectReaderTests-1534806197 None] Lock "cinder-quobyte-d2dec213-b440-4c13-a0c9-b3e71070893f" released by "delete_snapshot" :: held 1.488s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:49 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d Sep 05 11:52:49 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-d0162b79-e5c7-4c71-af45-7f36f367035a tempest-ProjectReaderTests-1534806197 None] Created reservations ['f53915f1-6faa-4e2d-b933-1e1391ea558e', '73d3abb3-89f6-471b-b692-714deb1fe0a8', 'ccf8d0e7-e412-47a4-a67f-1431548a13c1', '42ab958c-c9a8-415f-ab80-52a708053c73'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:52:49 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d0162b79-e5c7-4c71-af45-7f36f367035a tempest-ProjectReaderTests-1534806197 None] Delete snapshot completed successfully. Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d0162b79-e5c7-4c71-af45-7f36f367035a tempest-ProjectReaderTests-1534806197 None] Lock "cinder-7d8f1dc7-fd3c-4050-8027-f1f7c90f1aa1-delete_snapshot" released by "delete_snapshot" :: held 1.652s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:49 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d" returned: 0 in 0.243s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5d3322-0a32-460d-9005-1af5e6af9ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b123c56-7e59-487a-bee0-b2cffafeae1d', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aa54afa-5ad7-4664-a179-379adcafdb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:49 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] Volume volume-2b123c56-7e59-487a-bee0-b2cffafeae1d (2b123c56-7e59-487a-bee0-b2cffafeae1d): created successfully Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aa54afa-5ad7-4664-a179-379adcafdb55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:49 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] Flow 'volume_create_manager' (3706092a-7775-4b1e-a3ba-e15b2942db99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:52:49 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c623fd33-310c-42e9-aa5f-fdcb55cae93b tempest-ProjectMemberTests-1275208846 None] Created volume successfully. Sep 05 11:52:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5ab2d607-8ae9-43e5-937d-8dcd724ca405 tempest-ProjectReaderTests-1534806197 None] Acquiring lock "cinder-d2dec213-b440-4c13-a0c9-b3e71070893f-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5ab2d607-8ae9-43e5-937d-8dcd724ca405 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-d2dec213-b440-4c13-a0c9-b3e71070893f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5ab2d607-8ae9-43e5-937d-8dcd724ca405 tempest-ProjectReaderTests-1534806197 None] Acquiring lock "cinder-quobyte-d2dec213-b440-4c13-a0c9-b3e71070893f" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5ab2d607-8ae9-43e5-937d-8dcd724ca405 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-quobyte-d2dec213-b440-4c13-a0c9-b3e71070893f" acquired by "delete_volume" :: waited 0.013s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:50 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b185970-b475-4642-8108-600b69cba388]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5ab2d607-8ae9-43e5-937d-8dcd724ca405 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:50 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f Sep 05 11:52:50 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:50 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5ab2d607-8ae9-43e5-937d-8dcd724ca405 tempest-ProjectReaderTests-1534806197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f" returned: 0 in 0.347s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5ab2d607-8ae9-43e5-937d-8dcd724ca405 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:50 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f Sep 05 11:52:50 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:50 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5ab2d607-8ae9-43e5-937d-8dcd724ca405 tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d2dec213-b440-4c13-a0c9-b3e71070893f" returned: 0 in 0.242s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:50 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5ab2d607-8ae9-43e5-937d-8dcd724ca405 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-quobyte-d2dec213-b440-4c13-a0c9-b3e71070893f" released by "delete_volume" :: held 0.647s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:50 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-5ab2d607-8ae9-43e5-937d-8dcd724ca405 tempest-ProjectReaderTests-1534806197 None] Created reservations ['816220df-fd40-4171-a3e3-e79dbe7dbeb0', 'a27d8f59-b20b-4cac-835a-e284a5e8f162', 'a5a90d6a-c790-4aa5-a057-bb50e46b883a', '9f18d5f5-c87c-4d2d-8220-6d86cd378cdc'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:52:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5ab2d607-8ae9-43e5-937d-8dcd724ca405 tempest-ProjectReaderTests-1534806197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5ab2d607-8ae9-43e5-937d-8dcd724ca405 tempest-ProjectReaderTests-1534806197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5ab2d607-8ae9-43e5-937d-8dcd724ca405 tempest-ProjectReaderTests-1534806197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:50 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5ab2d607-8ae9-43e5-937d-8dcd724ca405 tempest-ProjectReaderTests-1534806197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5ab2d607-8ae9-43e5-937d-8dcd724ca405 tempest-ProjectReaderTests-1534806197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:50 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5ab2d607-8ae9-43e5-937d-8dcd724ca405 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:51 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:52:51 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9bfb8e99-b972-4b07-8dfc-adca710a7cd9 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9bfb8e99-b972-4b07-8dfc-adca710a7cd9 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:51 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-9bfb8e99-b972-4b07-8dfc-adca710a7cd9 tempest-ProjectMemberTests-1275208846 None] Creating offline snapshot 0b9997be-ea6e-41ae-963c-0579d95b2366 of volume 2b123c56-7e59-487a-bee0-b2cffafeae1d {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:52:51 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bd713c-931c-4ccc-9700-73fa32266d7c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9bfb8e99-b972-4b07-8dfc-adca710a7cd9 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:51 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5ab2d607-8ae9-43e5-937d-8dcd724ca405 tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.243s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:51 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-5ab2d607-8ae9-43e5-937d-8dcd724ca405 tempest-ProjectReaderTests-1534806197 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:52:51 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-5ab2d607-8ae9-43e5-937d-8dcd724ca405 tempest-ProjectReaderTests-1534806197 None] Deleted volume successfully. Sep 05 11:52:51 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-5ab2d607-8ae9-43e5-937d-8dcd724ca405 tempest-ProjectReaderTests-1534806197 None] Lock "cinder-d2dec213-b440-4c13-a0c9-b3e71070893f-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:51 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d Sep 05 11:52:51 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:51 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9bfb8e99-b972-4b07-8dfc-adca710a7cd9 tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d" returned: 0 in 0.394s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9bfb8e99-b972-4b07-8dfc-adca710a7cd9 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d.0b9997be-ea6e-41ae-963c-0579d95b2366 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:51 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d.0b9997be-ea6e-41ae-963c-0579d95b2366 1G Sep 05 11:52:51 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:51 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:52:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] Flow 'volume_create_manager' (fdc0663c-d756-4192-8688-9265ff689c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:52:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30535361-98fd-4c70-846d-892da722f840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30535361-98fd-4c70-846d-892da722f840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-270774852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d044e0a8-b6ae-4785-be79-0aa1c372c3ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19721c63425b45ed9804232ddcf1e000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:52:52Z,use_quota=True,user_id='335cdccede6c4f1eb437e1702bf54a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f580e0-3946-4fca-992f-f785f5745a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f580e0-3946-4fca-992f-f785f5745a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c6c23c-747a-43ce-b9eb-26b0acab4b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c6c23c-747a-43ce-b9eb-26b0acab4b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd044e0a8-b6ae-4785-be79-0aa1c372c3ab', 'volume_name': 'volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05436c38-45b3-4b32-acac-111ac7257103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05436c38-45b3-4b32-acac-111ac7257103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:51 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e046e990-7721-4066-9ce9-fabe83865b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:51 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] Volume d044e0a8-b6ae-4785-be79-0aa1c372c3ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab', 'volume_size': 1} Sep 05 11:52:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:51 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9bfb8e99-b972-4b07-8dfc-adca710a7cd9 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d.0b9997be-ea6e-41ae-963c-0579d95b2366 1G" returned: 0 in 0.390s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:51 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9bfb8e99-b972-4b07-8dfc-adca710a7cd9 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b123c56-7e59-487a-bee0-b2cffafeae1d -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d.0b9997be-ea6e-41ae-963c-0579d95b2366 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:51 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b123c56-7e59-487a-bee0-b2cffafeae1d -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d.0b9997be-ea6e-41ae-963c-0579d95b2366 Sep 05 11:52:51 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:52 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9bfb8e99-b972-4b07-8dfc-adca710a7cd9 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b123c56-7e59-487a-bee0-b2cffafeae1d -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d.0b9997be-ea6e-41ae-963c-0579d95b2366" returned: 0 in 0.277s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:52 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-9bfb8e99-b972-4b07-8dfc-adca710a7cd9 tempest-ProjectMemberTests-1275208846 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d.0b9997be-ea6e-41ae-963c-0579d95b2366 is being set with open permissions: ugo+rw Sep 05 11:52:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9bfb8e99-b972-4b07-8dfc-adca710a7cd9 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d.0b9997be-ea6e-41ae-963c-0579d95b2366 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:52 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d.0b9997be-ea6e-41ae-963c-0579d95b2366 Sep 05 11:52:52 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:52 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9bfb8e99-b972-4b07-8dfc-adca710a7cd9 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d.0b9997be-ea6e-41ae-963c-0579d95b2366" returned: 0 in 0.237s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:52 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=193,cinder:INSERT=69,cinder:UPDATE=245,cinder:DELETE=21 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:52:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9bfb8e99-b972-4b07-8dfc-adca710a7cd9 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:52 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d.info Sep 05 11:52:52 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:52 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9bfb8e99-b972-4b07-8dfc-adca710a7cd9 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d.info" returned: 0 in 0.244s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:52 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-9bfb8e99-b972-4b07-8dfc-adca710a7cd9 tempest-ProjectMemberTests-1275208846 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d.info is being set with open permissions: ugo+rw Sep 05 11:52:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9bfb8e99-b972-4b07-8dfc-adca710a7cd9 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:52 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d.info Sep 05 11:52:52 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:52 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-9bfb8e99-b972-4b07-8dfc-adca710a7cd9 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d.info" returned: 0 in 0.236s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:52 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-9bfb8e99-b972-4b07-8dfc-adca710a7cd9 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.860s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.126s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-270774852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d044e0a8-b6ae-4785-be79-0aa1c372c3ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19721c63425b45ed9804232ddcf1e000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:52:52Z,use_quota=True,user_id='335cdccede6c4f1eb437e1702bf54a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] Creating volume d044e0a8-b6ae-4785-be79-0aa1c372c3ab {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:52:53 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:53 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab 1073741824 Sep 05 11:52:53 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:53 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-9bfb8e99-b972-4b07-8dfc-adca710a7cd9 tempest-ProjectMemberTests-1275208846 None] Create snapshot completed successfully Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-aa817e9e-6af2-4ce7-9b61-574e29d1beae tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-0b9997be-ea6e-41ae-963c-0579d95b2366-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-aa817e9e-6af2-4ce7-9b61-574e29d1beae tempest-ProjectMemberTests-1275208846 None] Lock "cinder-0b9997be-ea6e-41ae-963c-0579d95b2366-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-aa817e9e-6af2-4ce7-9b61-574e29d1beae tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-quobyte-2b123c56-7e59-487a-bee0-b2cffafeae1d" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-aa817e9e-6af2-4ce7-9b61-574e29d1beae tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-2b123c56-7e59-487a-bee0-b2cffafeae1d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-aa817e9e-6af2-4ce7-9b61-574e29d1beae tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-quobyte-0b9997be-ea6e-41ae-963c-0579d95b2366" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-aa817e9e-6af2-4ce7-9b61-574e29d1beae tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-0b9997be-ea6e-41ae-963c-0579d95b2366" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-aa817e9e-6af2-4ce7-9b61-574e29d1beae tempest-ProjectMemberTests-1275208846 None] Deleting offline snapshot 0b9997be-ea6e-41ae-963c-0579d95b2366 of volume 2b123c56-7e59-487a-bee0-b2cffafeae1d {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-aa817e9e-6af2-4ce7-9b61-574e29d1beae tempest-ProjectMemberTests-1275208846 None] snapshot_file for this snap is: volume-2b123c56-7e59-487a-bee0-b2cffafeae1d.0b9997be-ea6e-41ae-963c-0579d95b2366 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fa9559-521b-466d-966e-768cb784f710]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aa817e9e-6af2-4ce7-9b61-574e29d1beae tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d.0b9997be-ea6e-41ae-963c-0579d95b2366 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:53 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab 1073741824" returned: 0 in 0.435s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:53 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d.0b9997be-ea6e-41ae-963c-0579d95b2366 Sep 05 11:52:53 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:53 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab Sep 05 11:52:53 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:53 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:53 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab" returned: 0 in 0.249s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aa817e9e-6af2-4ce7-9b61-574e29d1beae tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d.0b9997be-ea6e-41ae-963c-0579d95b2366" returned: 0 in 0.375s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-aa817e9e-6af2-4ce7-9b61-574e29d1beae tempest-ProjectMemberTests-1275208846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b123c56-7e59-487a-bee0-b2cffafeae1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e046e990-7721-4066-9ce9-fabe83865b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ee447e-6537-4b14-9378-9cf65ce09388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c6fb47-0fe0-4a96-937f-28e54fc343fe]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=197,cinder:INSERT=70,cinder:UPDATE=254,cinder:DELETE=21 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aa817e9e-6af2-4ce7-9b61-574e29d1beae tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:53 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] Volume volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab (d044e0a8-b6ae-4785-be79-0aa1c372c3ab): created successfully Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ee447e-6537-4b14-9378-9cf65ce09388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:53 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] Flow 'volume_create_manager' (fdc0663c-d756-4192-8688-9265ff689c6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:52:53 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-4ff326ff-dd2a-438f-a813-93a36c4f0c34 tempest-ProjectReaderTests-1534806197 None] Created volume successfully. Sep 05 11:52:53 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d Sep 05 11:52:53 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:54 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aa817e9e-6af2-4ce7-9b61-574e29d1beae tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d" returned: 0 in 0.372s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aa817e9e-6af2-4ce7-9b61-574e29d1beae tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d.0b9997be-ea6e-41ae-963c-0579d95b2366 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:54 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d.0b9997be-ea6e-41ae-963c-0579d95b2366 Sep 05 11:52:54 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:54 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aa817e9e-6af2-4ce7-9b61-574e29d1beae tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d.0b9997be-ea6e-41ae-963c-0579d95b2366" returned: 0 in 0.322s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aa817e9e-6af2-4ce7-9b61-574e29d1beae tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d.0b9997be-ea6e-41ae-963c-0579d95b2366 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:54 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d.0b9997be-ea6e-41ae-963c-0579d95b2366 Sep 05 11:52:54 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:54 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:54 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-aa817e9e-6af2-4ce7-9b61-574e29d1beae tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d.0b9997be-ea6e-41ae-963c-0579d95b2366" returned: 0 in 0.260s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-aa817e9e-6af2-4ce7-9b61-574e29d1beae tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-0b9997be-ea6e-41ae-963c-0579d95b2366" released by "_delete_snapshot" :: held 1.433s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-aa817e9e-6af2-4ce7-9b61-574e29d1beae tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-2b123c56-7e59-487a-bee0-b2cffafeae1d" released by "delete_snapshot" :: held 1.457s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:54 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-aa817e9e-6af2-4ce7-9b61-574e29d1beae tempest-ProjectMemberTests-1275208846 None] Created reservations ['9da63404-bd38-41e3-9d6d-13bfca1e3759', '3193059d-544d-4787-aa1a-651695ca6c2c', '2472374f-4ed9-442f-96b5-43fad85fe5ec', '8a1a43cf-ff6f-4b4b-83af-3ba9d904e9c1'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:52:54 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-aa817e9e-6af2-4ce7-9b61-574e29d1beae tempest-ProjectMemberTests-1275208846 None] Delete snapshot completed successfully. Sep 05 11:52:54 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-aa817e9e-6af2-4ce7-9b61-574e29d1beae tempest-ProjectMemberTests-1275208846 None] Lock "cinder-0b9997be-ea6e-41ae-963c-0579d95b2366-delete_snapshot" released by "delete_snapshot" :: held 1.618s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d2213e87-64ac-4d63-968c-454fba17ba4c tempest-ProjectReaderTests-1534806197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d2213e87-64ac-4d63-968c-454fba17ba4c tempest-ProjectReaderTests-1534806197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:55 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-d2213e87-64ac-4d63-968c-454fba17ba4c tempest-ProjectReaderTests-1534806197 None] Creating offline snapshot 5a8af3af-004e-4531-b778-1321d06ac94c of volume d044e0a8-b6ae-4785-be79-0aa1c372c3ab {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:52:55 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbb7a27-2817-43f2-86a9-29d97df36eb2]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d2213e87-64ac-4d63-968c-454fba17ba4c tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:55 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab Sep 05 11:52:55 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e02f1681-b11f-4d49-91a7-dca240d07d36 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-2b123c56-7e59-487a-bee0-b2cffafeae1d-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:55 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d2213e87-64ac-4d63-968c-454fba17ba4c tempest-ProjectReaderTests-1534806197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab" returned: 0 in 0.367s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d2213e87-64ac-4d63-968c-454fba17ba4c tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab.5a8af3af-004e-4531-b778-1321d06ac94c 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e02f1681-b11f-4d49-91a7-dca240d07d36 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-2b123c56-7e59-487a-bee0-b2cffafeae1d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:55 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab.5a8af3af-004e-4531-b778-1321d06ac94c 1G Sep 05 11:52:55 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e02f1681-b11f-4d49-91a7-dca240d07d36 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-quobyte-2b123c56-7e59-487a-bee0-b2cffafeae1d" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:55 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e02f1681-b11f-4d49-91a7-dca240d07d36 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-2b123c56-7e59-487a-bee0-b2cffafeae1d" acquired by "delete_volume" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:55 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3e4f94-46b2-46d5-b65e-8492592ec26b]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e02f1681-b11f-4d49-91a7-dca240d07d36 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:55 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d Sep 05 11:52:55 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:55 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d2213e87-64ac-4d63-968c-454fba17ba4c tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab.5a8af3af-004e-4531-b778-1321d06ac94c 1G" returned: 0 in 0.404s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d2213e87-64ac-4d63-968c-454fba17ba4c tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab.5a8af3af-004e-4531-b778-1321d06ac94c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:55 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab.5a8af3af-004e-4531-b778-1321d06ac94c Sep 05 11:52:55 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:55 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e02f1681-b11f-4d49-91a7-dca240d07d36 tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d" returned: 0 in 0.378s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:55 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e02f1681-b11f-4d49-91a7-dca240d07d36 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:55 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d Sep 05 11:52:55 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:56 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d2213e87-64ac-4d63-968c-454fba17ba4c tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab.5a8af3af-004e-4531-b778-1321d06ac94c" returned: 0 in 0.296s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:56 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-d2213e87-64ac-4d63-968c-454fba17ba4c tempest-ProjectReaderTests-1534806197 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab.5a8af3af-004e-4531-b778-1321d06ac94c is being set with open permissions: ugo+rw Sep 05 11:52:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d2213e87-64ac-4d63-968c-454fba17ba4c tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab.5a8af3af-004e-4531-b778-1321d06ac94c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:56 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab.5a8af3af-004e-4531-b778-1321d06ac94c Sep 05 11:52:56 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:56 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e02f1681-b11f-4d49-91a7-dca240d07d36 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-2b123c56-7e59-487a-bee0-b2cffafeae1d" returned: 0 in 0.261s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e02f1681-b11f-4d49-91a7-dca240d07d36 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-2b123c56-7e59-487a-bee0-b2cffafeae1d" released by "delete_volume" :: held 0.694s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:56 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-e02f1681-b11f-4d49-91a7-dca240d07d36 tempest-ProjectMemberTests-1275208846 None] Created reservations ['ead91393-24a0-4a2f-b4f5-e85d05851f28', 'e68929f0-7957-4f42-b8a3-06e00909cb74', '22c97c11-adda-4407-805a-f660db9aaa21', '7d49625c-25ee-4e36-af72-f7f163874a89'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:52:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e02f1681-b11f-4d49-91a7-dca240d07d36 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e02f1681-b11f-4d49-91a7-dca240d07d36 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e02f1681-b11f-4d49-91a7-dca240d07d36 tempest-ProjectMemberTests-1275208846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:56 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e02f1681-b11f-4d49-91a7-dca240d07d36 tempest-ProjectMemberTests-1275208846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e02f1681-b11f-4d49-91a7-dca240d07d36 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e02f1681-b11f-4d49-91a7-dca240d07d36 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:56 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:52:56 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:56 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d2213e87-64ac-4d63-968c-454fba17ba4c tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab.5a8af3af-004e-4531-b778-1321d06ac94c" returned: 0 in 0.257s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d2213e87-64ac-4d63-968c-454fba17ba4c tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:56 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab.info Sep 05 11:52:56 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:56 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e02f1681-b11f-4d49-91a7-dca240d07d36 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.276s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:56 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-e02f1681-b11f-4d49-91a7-dca240d07d36 tempest-ProjectMemberTests-1275208846 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:52:56 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e02f1681-b11f-4d49-91a7-dca240d07d36 tempest-ProjectMemberTests-1275208846 None] Deleted volume successfully. Sep 05 11:52:56 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e02f1681-b11f-4d49-91a7-dca240d07d36 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-2b123c56-7e59-487a-bee0-b2cffafeae1d-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:56 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d2213e87-64ac-4d63-968c-454fba17ba4c tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab.info" returned: 0 in 0.250s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:56 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-d2213e87-64ac-4d63-968c-454fba17ba4c tempest-ProjectReaderTests-1534806197 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab.info is being set with open permissions: ugo+rw Sep 05 11:52:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d2213e87-64ac-4d63-968c-454fba17ba4c tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:56 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab.info Sep 05 11:52:56 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:56 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d2213e87-64ac-4d63-968c-454fba17ba4c tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab.info" returned: 0 in 0.259s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:56 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-d2213e87-64ac-4d63-968c-454fba17ba4c tempest-ProjectReaderTests-1534806197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.911s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:56 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d2213e87-64ac-4d63-968c-454fba17ba4c tempest-ProjectReaderTests-1534806197 None] Create snapshot completed successfully Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] Flow 'volume_create_manager' (84161b2a-5f5a-41db-ac18-67ffac0a880e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c213a499-679f-4a47-ad4c-30db6c9b5764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c213a499-679f-4a47-ad4c-30db6c9b5764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-917277840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f6bf929-82a0-4191-ae07-40fe05007bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47eb7f5800ca42a8aac1df1019b50492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:52:57Z,use_quota=True,user_id='4498bbe7acb84612bf0e189659c0581e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fe4a500-b0f4-4968-af12-49e5b0e3dbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fe4a500-b0f4-4968-af12-49e5b0e3dbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfe194b0-5dd3-4e8d-a9e2-9f22b9167628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfe194b0-5dd3-4e8d-a9e2-9f22b9167628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f6bf929-82a0-4191-ae07-40fe05007bca', 'volume_name': 'volume-5f6bf929-82a0-4191-ae07-40fe05007bca', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf4912e8-f0c0-4d35-b383-cd91886b5b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf4912e8-f0c0-4d35-b383-cd91886b5b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23fa56cf-a482-4679-a87a-1e1e21b3fd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:57 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] Volume 5f6bf929-82a0-4191-ae07-40fe05007bca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f6bf929-82a0-4191-ae07-40fe05007bca', 'volume_size': 1} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-917277840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f6bf929-82a0-4191-ae07-40fe05007bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47eb7f5800ca42a8aac1df1019b50492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:52:57Z,use_quota=True,user_id='4498bbe7acb84612bf0e189659c0581e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] Creating volume 5f6bf929-82a0-4191-ae07-40fe05007bca {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:52:57 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-990b7079-ff7e-4050-93d7-5595d44eca1a tempest-ProjectReaderTests-1534806197 None] Acquiring lock "cinder-5a8af3af-004e-4531-b778-1321d06ac94c-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:57 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca 1073741824 Sep 05 11:52:57 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-990b7079-ff7e-4050-93d7-5595d44eca1a tempest-ProjectReaderTests-1534806197 None] Lock "cinder-5a8af3af-004e-4531-b778-1321d06ac94c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-990b7079-ff7e-4050-93d7-5595d44eca1a tempest-ProjectReaderTests-1534806197 None] Acquiring lock "cinder-quobyte-d044e0a8-b6ae-4785-be79-0aa1c372c3ab" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-990b7079-ff7e-4050-93d7-5595d44eca1a tempest-ProjectReaderTests-1534806197 None] Lock "cinder-quobyte-d044e0a8-b6ae-4785-be79-0aa1c372c3ab" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-990b7079-ff7e-4050-93d7-5595d44eca1a tempest-ProjectReaderTests-1534806197 None] Acquiring lock "cinder-quobyte-5a8af3af-004e-4531-b778-1321d06ac94c" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-990b7079-ff7e-4050-93d7-5595d44eca1a tempest-ProjectReaderTests-1534806197 None] Lock "cinder-quobyte-5a8af3af-004e-4531-b778-1321d06ac94c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-990b7079-ff7e-4050-93d7-5595d44eca1a tempest-ProjectReaderTests-1534806197 None] Deleting offline snapshot 5a8af3af-004e-4531-b778-1321d06ac94c of volume d044e0a8-b6ae-4785-be79-0aa1c372c3ab {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-990b7079-ff7e-4050-93d7-5595d44eca1a tempest-ProjectReaderTests-1534806197 None] snapshot_file for this snap is: volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab.5a8af3af-004e-4531-b778-1321d06ac94c {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[370136b5-01de-41bc-8e09-9444770e1d1d]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-990b7079-ff7e-4050-93d7-5595d44eca1a tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab.5a8af3af-004e-4531-b778-1321d06ac94c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:57 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab.5a8af3af-004e-4531-b778-1321d06ac94c Sep 05 11:52:57 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:57 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca 1073741824" returned: 0 in 0.446s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:57 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-990b7079-ff7e-4050-93d7-5595d44eca1a tempest-ProjectReaderTests-1534806197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab.5a8af3af-004e-4531-b778-1321d06ac94c" returned: 0 in 0.376s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-990b7079-ff7e-4050-93d7-5595d44eca1a tempest-ProjectReaderTests-1534806197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:52:57 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca Sep 05 11:52:57 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf9f11b-2db4-42d5-9473-e20ba3e9e834]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-990b7079-ff7e-4050-93d7-5595d44eca1a tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:57 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab Sep 05 11:52:57 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:57 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca" returned: 0 in 0.252s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23fa56cf-a482-4679-a87a-1e1e21b3fd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f6bf929-82a0-4191-ae07-40fe05007bca', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a3f6862-ebb2-42a8-a17e-c2568e9c0e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:52:57 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] Volume volume-5f6bf929-82a0-4191-ae07-40fe05007bca (5f6bf929-82a0-4191-ae07-40fe05007bca): created successfully Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a3f6862-ebb2-42a8-a17e-c2568e9c0e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:52:57 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] Flow 'volume_create_manager' (84161b2a-5f5a-41db-ac18-67ffac0a880e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:52:57 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-986bbc26-31fb-47c9-aa51-4857577a044d tempest-ProjectMemberTests-1275208846 None] Created volume successfully. Sep 05 11:52:58 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-990b7079-ff7e-4050-93d7-5595d44eca1a tempest-ProjectReaderTests-1534806197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab" returned: 0 in 0.373s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-990b7079-ff7e-4050-93d7-5595d44eca1a tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab.5a8af3af-004e-4531-b778-1321d06ac94c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:58 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab.5a8af3af-004e-4531-b778-1321d06ac94c Sep 05 11:52:58 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-dacc8183-ed9c-4a06-b518-a04fdd795be8 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:52:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-dacc8183-ed9c-4a06-b518-a04fdd795be8 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:52:58 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-dacc8183-ed9c-4a06-b518-a04fdd795be8 tempest-ProjectMemberTests-1275208846 None] Creating offline snapshot 15cb6748-637f-4757-8f72-7600bc6c2d17 of volume 5f6bf929-82a0-4191-ae07-40fe05007bca {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:52:58 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b686fd-de24-40a7-a98f-a4dc435142be]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dacc8183-ed9c-4a06-b518-a04fdd795be8 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:58 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca Sep 05 11:52:58 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:58 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-990b7079-ff7e-4050-93d7-5595d44eca1a tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab.5a8af3af-004e-4531-b778-1321d06ac94c" returned: 0 in 0.360s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-990b7079-ff7e-4050-93d7-5595d44eca1a tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab.5a8af3af-004e-4531-b778-1321d06ac94c {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:58 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab.5a8af3af-004e-4531-b778-1321d06ac94c Sep 05 11:52:58 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:58 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dacc8183-ed9c-4a06-b518-a04fdd795be8 tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca" returned: 0 in 0.372s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dacc8183-ed9c-4a06-b518-a04fdd795be8 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca.15cb6748-637f-4757-8f72-7600bc6c2d17 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:58 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:58 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-990b7079-ff7e-4050-93d7-5595d44eca1a tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab.5a8af3af-004e-4531-b778-1321d06ac94c" returned: 0 in 0.262s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:58 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca.15cb6748-637f-4757-8f72-7600bc6c2d17 1G Sep 05 11:52:58 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-990b7079-ff7e-4050-93d7-5595d44eca1a tempest-ProjectReaderTests-1534806197 None] Lock "cinder-quobyte-5a8af3af-004e-4531-b778-1321d06ac94c" released by "_delete_snapshot" :: held 1.478s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-990b7079-ff7e-4050-93d7-5595d44eca1a tempest-ProjectReaderTests-1534806197 None] Lock "cinder-quobyte-d044e0a8-b6ae-4785-be79-0aa1c372c3ab" released by "delete_snapshot" :: held 1.508s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:58 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-990b7079-ff7e-4050-93d7-5595d44eca1a tempest-ProjectReaderTests-1534806197 None] Created reservations ['6f9ff8ab-c8ad-4d56-8103-690b108e4517', '13287517-c1c6-43e4-a9dc-80dc483adfbe', '12db1f91-ef70-4a3a-b6ab-e5ed3d5134df', '3c4c0558-df61-4376-9ab1-e8dcf7f08232'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:52:58 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-990b7079-ff7e-4050-93d7-5595d44eca1a tempest-ProjectReaderTests-1534806197 None] Delete snapshot completed successfully. Sep 05 11:52:58 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-990b7079-ff7e-4050-93d7-5595d44eca1a tempest-ProjectReaderTests-1534806197 None] Lock "cinder-5a8af3af-004e-4531-b778-1321d06ac94c-delete_snapshot" released by "delete_snapshot" :: held 1.663s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:52:59 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dacc8183-ed9c-4a06-b518-a04fdd795be8 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca.15cb6748-637f-4757-8f72-7600bc6c2d17 1G" returned: 0 in 0.420s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dacc8183-ed9c-4a06-b518-a04fdd795be8 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f6bf929-82a0-4191-ae07-40fe05007bca -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca.15cb6748-637f-4757-8f72-7600bc6c2d17 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:59 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f6bf929-82a0-4191-ae07-40fe05007bca -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca.15cb6748-637f-4757-8f72-7600bc6c2d17 Sep 05 11:52:59 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bb2bb306-2062-4274-8886-92bf4df694db tempest-ProjectReaderTests-1534806197 None] Acquiring lock "cinder-d044e0a8-b6ae-4785-be79-0aa1c372c3ab-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:59 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dacc8183-ed9c-4a06-b518-a04fdd795be8 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f6bf929-82a0-4191-ae07-40fe05007bca -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca.15cb6748-637f-4757-8f72-7600bc6c2d17" returned: 0 in 0.300s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:59 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-dacc8183-ed9c-4a06-b518-a04fdd795be8 tempest-ProjectMemberTests-1275208846 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca.15cb6748-637f-4757-8f72-7600bc6c2d17 is being set with open permissions: ugo+rw Sep 05 11:52:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dacc8183-ed9c-4a06-b518-a04fdd795be8 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca.15cb6748-637f-4757-8f72-7600bc6c2d17 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bb2bb306-2062-4274-8886-92bf4df694db tempest-ProjectReaderTests-1534806197 None] Lock "cinder-d044e0a8-b6ae-4785-be79-0aa1c372c3ab-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:59 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca.15cb6748-637f-4757-8f72-7600bc6c2d17 Sep 05 11:52:59 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bb2bb306-2062-4274-8886-92bf4df694db tempest-ProjectReaderTests-1534806197 None] Acquiring lock "cinder-quobyte-d044e0a8-b6ae-4785-be79-0aa1c372c3ab" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:52:59 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bb2bb306-2062-4274-8886-92bf4df694db tempest-ProjectReaderTests-1534806197 None] Lock "cinder-quobyte-d044e0a8-b6ae-4785-be79-0aa1c372c3ab" acquired by "delete_volume" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:52:59 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e14ec0-8016-4086-8b76-d8e96600b692]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:52:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bb2bb306-2062-4274-8886-92bf4df694db tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:59 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab Sep 05 11:52:59 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:59 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dacc8183-ed9c-4a06-b518-a04fdd795be8 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca.15cb6748-637f-4757-8f72-7600bc6c2d17" returned: 0 in 0.269s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dacc8183-ed9c-4a06-b518-a04fdd795be8 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:59 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca.info Sep 05 11:52:59 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:59 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bb2bb306-2062-4274-8886-92bf4df694db tempest-ProjectReaderTests-1534806197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab" returned: 0 in 0.371s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bb2bb306-2062-4274-8886-92bf4df694db tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:59 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab Sep 05 11:52:59 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:52:59 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Sep 05 11:52:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dacc8183-ed9c-4a06-b518-a04fdd795be8 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca.info" returned: 0 in 0.252s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:52:59 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-dacc8183-ed9c-4a06-b518-a04fdd795be8 tempest-ProjectMemberTests-1275208846 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca.info is being set with open permissions: ugo+rw Sep 05 11:52:59 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dacc8183-ed9c-4a06-b518-a04fdd795be8 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:52:59 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca.info Sep 05 11:52:59 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:00 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bb2bb306-2062-4274-8886-92bf4df694db tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-d044e0a8-b6ae-4785-be79-0aa1c372c3ab" returned: 0 in 0.245s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bb2bb306-2062-4274-8886-92bf4df694db tempest-ProjectReaderTests-1534806197 None] Lock "cinder-quobyte-d044e0a8-b6ae-4785-be79-0aa1c372c3ab" released by "delete_volume" :: held 0.675s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:53:00 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-dacc8183-ed9c-4a06-b518-a04fdd795be8 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca.info" returned: 0 in 0.245s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-dacc8183-ed9c-4a06-b518-a04fdd795be8 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.938s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:53:00 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-bb2bb306-2062-4274-8886-92bf4df694db tempest-ProjectReaderTests-1534806197 None] Created reservations ['59bbdd65-ea73-4e47-a789-63167e07fcd8', '4cabae2c-bac8-4398-bbae-836e4a724f67', '4044aa9c-e8fe-475d-9f39-4456c2b5bd41', 'e900360a-5e38-45d3-a441-7d564a42d640'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:53:00 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-dacc8183-ed9c-4a06-b518-a04fdd795be8 tempest-ProjectMemberTests-1275208846 None] Create snapshot completed successfully Sep 05 11:53:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bb2bb306-2062-4274-8886-92bf4df694db tempest-ProjectReaderTests-1534806197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:53:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bb2bb306-2062-4274-8886-92bf4df694db tempest-ProjectReaderTests-1534806197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:53:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bb2bb306-2062-4274-8886-92bf4df694db tempest-ProjectReaderTests-1534806197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:53:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-bb2bb306-2062-4274-8886-92bf4df694db tempest-ProjectReaderTests-1534806197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:53:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-bb2bb306-2062-4274-8886-92bf4df694db tempest-ProjectReaderTests-1534806197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:53:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bb2bb306-2062-4274-8886-92bf4df694db tempest-ProjectReaderTests-1534806197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:00 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:53:00 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-91bd12db-dffb-4c29-91e5-f9aa1200803e tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-15cb6748-637f-4757-8f72-7600bc6c2d17-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:53:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-91bd12db-dffb-4c29-91e5-f9aa1200803e tempest-ProjectMemberTests-1275208846 None] Lock "cinder-15cb6748-637f-4757-8f72-7600bc6c2d17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:53:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-91bd12db-dffb-4c29-91e5-f9aa1200803e tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-quobyte-5f6bf929-82a0-4191-ae07-40fe05007bca" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:53:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-91bd12db-dffb-4c29-91e5-f9aa1200803e tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-5f6bf929-82a0-4191-ae07-40fe05007bca" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:53:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-91bd12db-dffb-4c29-91e5-f9aa1200803e tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-quobyte-15cb6748-637f-4757-8f72-7600bc6c2d17" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:53:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-91bd12db-dffb-4c29-91e5-f9aa1200803e tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-15cb6748-637f-4757-8f72-7600bc6c2d17" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:53:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-91bd12db-dffb-4c29-91e5-f9aa1200803e tempest-ProjectMemberTests-1275208846 None] Deleting offline snapshot 15cb6748-637f-4757-8f72-7600bc6c2d17 of volume 5f6bf929-82a0-4191-ae07-40fe05007bca {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:53:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-91bd12db-dffb-4c29-91e5-f9aa1200803e tempest-ProjectMemberTests-1275208846 None] snapshot_file for this snap is: volume-5f6bf929-82a0-4191-ae07-40fe05007bca.15cb6748-637f-4757-8f72-7600bc6c2d17 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:53:00 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc027957-86c1-4e77-b125-e7432940b9d7]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:53:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-91bd12db-dffb-4c29-91e5-f9aa1200803e tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca.15cb6748-637f-4757-8f72-7600bc6c2d17 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:00 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-bb2bb306-2062-4274-8886-92bf4df694db tempest-ProjectReaderTests-1534806197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.260s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:00 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-bb2bb306-2062-4274-8886-92bf4df694db tempest-ProjectReaderTests-1534806197 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:53:00 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-bb2bb306-2062-4274-8886-92bf4df694db tempest-ProjectReaderTests-1534806197 None] Deleted volume successfully. Sep 05 11:53:00 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-bb2bb306-2062-4274-8886-92bf4df694db tempest-ProjectReaderTests-1534806197 None] Lock "cinder-d044e0a8-b6ae-4785-be79-0aa1c372c3ab-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:53:00 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca.15cb6748-637f-4757-8f72-7600bc6c2d17 Sep 05 11:53:00 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:00 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-91bd12db-dffb-4c29-91e5-f9aa1200803e tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca.15cb6748-637f-4757-8f72-7600bc6c2d17" returned: 0 in 0.359s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:00 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-91bd12db-dffb-4c29-91e5-f9aa1200803e tempest-ProjectMemberTests-1275208846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f6bf929-82a0-4191-ae07-40fe05007bca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:53:00 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[6824ae8a-f01c-45eb-9ab4-9401420d59d7]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:53:00 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-91bd12db-dffb-4c29-91e5-f9aa1200803e tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:00 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca Sep 05 11:53:00 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:01 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-91bd12db-dffb-4c29-91e5-f9aa1200803e tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca" returned: 0 in 0.401s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-91bd12db-dffb-4c29-91e5-f9aa1200803e tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca.15cb6748-637f-4757-8f72-7600bc6c2d17 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:01 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca.15cb6748-637f-4757-8f72-7600bc6c2d17 Sep 05 11:53:01 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:01 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-91bd12db-dffb-4c29-91e5-f9aa1200803e tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca.15cb6748-637f-4757-8f72-7600bc6c2d17" returned: 0 in 0.383s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-91bd12db-dffb-4c29-91e5-f9aa1200803e tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca.15cb6748-637f-4757-8f72-7600bc6c2d17 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:01 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca.15cb6748-637f-4757-8f72-7600bc6c2d17 Sep 05 11:53:01 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:01 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:01 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-91bd12db-dffb-4c29-91e5-f9aa1200803e tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca.15cb6748-637f-4757-8f72-7600bc6c2d17" returned: 0 in 0.276s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-91bd12db-dffb-4c29-91e5-f9aa1200803e tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-15cb6748-637f-4757-8f72-7600bc6c2d17" released by "_delete_snapshot" :: held 1.515s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:53:01 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-91bd12db-dffb-4c29-91e5-f9aa1200803e tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-5f6bf929-82a0-4191-ae07-40fe05007bca" released by "delete_snapshot" :: held 1.540s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:53:02 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-91bd12db-dffb-4c29-91e5-f9aa1200803e tempest-ProjectMemberTests-1275208846 None] Created reservations ['d72b3b5a-1aec-4bea-b598-0ee0cf1e849c', '7a4ab931-985f-480f-89cc-96e45c622bd4', 'a2c3d6a0-d70b-4121-b38e-1ac4ca5b94b8', 'd6544ded-811e-4dfa-9e9f-a66627c0b0f1'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:53:02 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-91bd12db-dffb-4c29-91e5-f9aa1200803e tempest-ProjectMemberTests-1275208846 None] Delete snapshot completed successfully. Sep 05 11:53:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-91bd12db-dffb-4c29-91e5-f9aa1200803e tempest-ProjectMemberTests-1275208846 None] Lock "cinder-15cb6748-637f-4757-8f72-7600bc6c2d17-delete_snapshot" released by "delete_snapshot" :: held 1.705s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:53:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-103a6eac-3287-447b-8631-bf0f8373dcc2 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-5f6bf929-82a0-4191-ae07-40fe05007bca-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:53:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-103a6eac-3287-447b-8631-bf0f8373dcc2 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-5f6bf929-82a0-4191-ae07-40fe05007bca-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:53:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-103a6eac-3287-447b-8631-bf0f8373dcc2 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-quobyte-5f6bf929-82a0-4191-ae07-40fe05007bca" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:53:02 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-103a6eac-3287-447b-8631-bf0f8373dcc2 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-5f6bf929-82a0-4191-ae07-40fe05007bca" acquired by "delete_volume" :: waited 0.019s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:53:02 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[76608ef2-b53a-464a-bcc6-d118a4a95681]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:53:02 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-103a6eac-3287-447b-8631-bf0f8373dcc2 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:02 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca Sep 05 11:53:02 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:03 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-103a6eac-3287-447b-8631-bf0f8373dcc2 tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca" returned: 0 in 0.378s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-103a6eac-3287-447b-8631-bf0f8373dcc2 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:03 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca Sep 05 11:53:03 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:03 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-103a6eac-3287-447b-8631-bf0f8373dcc2 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-5f6bf929-82a0-4191-ae07-40fe05007bca" returned: 0 in 0.269s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-103a6eac-3287-447b-8631-bf0f8373dcc2 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-5f6bf929-82a0-4191-ae07-40fe05007bca" released by "delete_volume" :: held 0.713s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:53:03 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-103a6eac-3287-447b-8631-bf0f8373dcc2 tempest-ProjectMemberTests-1275208846 None] Created reservations ['ec74fff4-0a33-4154-928b-38e5bf2e19ea', '215075de-e367-4375-a572-4f0e80893984', '28950ff2-321c-4206-8366-f09688348bae', '6ec2224c-9bbc-4785-8d0d-dd0c20d0a98b'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:53:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-103a6eac-3287-447b-8631-bf0f8373dcc2 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:53:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-103a6eac-3287-447b-8631-bf0f8373dcc2 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:53:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-103a6eac-3287-447b-8631-bf0f8373dcc2 tempest-ProjectMemberTests-1275208846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:53:03 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-103a6eac-3287-447b-8631-bf0f8373dcc2 tempest-ProjectMemberTests-1275208846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:53:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-103a6eac-3287-447b-8631-bf0f8373dcc2 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:53:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-103a6eac-3287-447b-8631-bf0f8373dcc2 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:03 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:53:03 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:03 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:03 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-103a6eac-3287-447b-8631-bf0f8373dcc2 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.283s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:03 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-103a6eac-3287-447b-8631-bf0f8373dcc2 tempest-ProjectMemberTests-1275208846 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:53:03 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-103a6eac-3287-447b-8631-bf0f8373dcc2 tempest-ProjectMemberTests-1275208846 None] Deleted volume successfully. Sep 05 11:53:03 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-103a6eac-3287-447b-8631-bf0f8373dcc2 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-5f6bf929-82a0-4191-ae07-40fe05007bca-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:53:04 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:53:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] Flow 'volume_create_manager' (9960c0c9-6f80-4c6c-ae54-8eb6f77b577d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:53:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98708dba-a6c2-4a5f-b21b-6713719fcec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:53:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98708dba-a6c2-4a5f-b21b-6713719fcec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1343634120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8be92971-bca1-4a44-b71d-767b8707d698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47eb7f5800ca42a8aac1df1019b50492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:53:04Z,use_quota=True,user_id='4498bbe7acb84612bf0e189659c0581e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:53:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c07d2c-5f95-4bc7-95a8-7941de564f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:53:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c07d2c-5f95-4bc7-95a8-7941de564f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:53:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a660d30-e7b5-4d5f-884f-2b7bb2a5795b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:53:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a660d30-e7b5-4d5f-884f-2b7bb2a5795b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8be92971-bca1-4a44-b71d-767b8707d698', 'volume_name': 'volume-8be92971-bca1-4a44-b71d-767b8707d698', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:53:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (391bff8d-5d4d-40d1-80c4-0e7f43525436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:53:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (391bff8d-5d4d-40d1-80c4-0e7f43525436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:53:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dd63664-1edc-4531-89f4-7a59c30ca87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:53:04 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] Volume 8be92971-bca1-4a44-b71d-767b8707d698: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8be92971-bca1-4a44-b71d-767b8707d698', 'volume_size': 1} Sep 05 11:53:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:53:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:53:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1343634120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8be92971-bca1-4a44-b71d-767b8707d698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47eb7f5800ca42a8aac1df1019b50492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:53:04Z,use_quota=True,user_id='4498bbe7acb84612bf0e189659c0581e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:53:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] Creating volume 8be92971-bca1-4a44-b71d-767b8707d698 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:53:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:53:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:53:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:53:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:53:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:53:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:53:04 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:53:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:04 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698 1073741824 Sep 05 11:53:04 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:04 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698 1073741824" returned: 0 in 0.396s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:04 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698 Sep 05 11:53:04 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:04 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698" returned: 0 in 0.272s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:04 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:53:04 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:53:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dd63664-1edc-4531-89f4-7a59c30ca87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8be92971-bca1-4a44-b71d-767b8707d698', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:53:04 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa59636c-d361-47e5-9873-6bb1aa4849ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:53:05 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] Volume volume-8be92971-bca1-4a44-b71d-767b8707d698 (8be92971-bca1-4a44-b71d-767b8707d698): created successfully Sep 05 11:53:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa59636c-d361-47e5-9873-6bb1aa4849ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:53:05 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] Flow 'volume_create_manager' (9960c0c9-6f80-4c6c-ae54-8eb6f77b577d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:53:05 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-4da7c60c-098f-4a26-a6e9-4efc7df616dc tempest-ProjectMemberTests-1275208846 None] Created volume successfully. Sep 05 11:53:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c9b0a099-449e-4134-93bb-8225808f7115 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:53:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c9b0a099-449e-4134-93bb-8225808f7115 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:53:05 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-c9b0a099-449e-4134-93bb-8225808f7115 tempest-ProjectMemberTests-1275208846 None] Creating offline snapshot 0a31d330-752b-41c2-a545-4007320fcfa3 of volume 8be92971-bca1-4a44-b71d-767b8707d698 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:53:05 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e034f0df-9926-4fe6-996f-02988a62ecd2]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:53:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c9b0a099-449e-4134-93bb-8225808f7115 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:05 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698 Sep 05 11:53:05 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:05 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c9b0a099-449e-4134-93bb-8225808f7115 tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698" returned: 0 in 0.396s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:05 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c9b0a099-449e-4134-93bb-8225808f7115 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698.0a31d330-752b-41c2-a545-4007320fcfa3 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:05 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698.0a31d330-752b-41c2-a545-4007320fcfa3 1G Sep 05 11:53:05 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:06 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c9b0a099-449e-4134-93bb-8225808f7115 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698.0a31d330-752b-41c2-a545-4007320fcfa3 1G" returned: 0 in 0.377s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c9b0a099-449e-4134-93bb-8225808f7115 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8be92971-bca1-4a44-b71d-767b8707d698 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698.0a31d330-752b-41c2-a545-4007320fcfa3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:06 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8be92971-bca1-4a44-b71d-767b8707d698 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698.0a31d330-752b-41c2-a545-4007320fcfa3 Sep 05 11:53:06 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:06 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c9b0a099-449e-4134-93bb-8225808f7115 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8be92971-bca1-4a44-b71d-767b8707d698 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698.0a31d330-752b-41c2-a545-4007320fcfa3" returned: 0 in 0.280s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:06 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-c9b0a099-449e-4134-93bb-8225808f7115 tempest-ProjectMemberTests-1275208846 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698.0a31d330-752b-41c2-a545-4007320fcfa3 is being set with open permissions: ugo+rw Sep 05 11:53:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c9b0a099-449e-4134-93bb-8225808f7115 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698.0a31d330-752b-41c2-a545-4007320fcfa3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:06 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698.0a31d330-752b-41c2-a545-4007320fcfa3 Sep 05 11:53:06 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:06 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c9b0a099-449e-4134-93bb-8225808f7115 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698.0a31d330-752b-41c2-a545-4007320fcfa3" returned: 0 in 0.248s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:06 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c9b0a099-449e-4134-93bb-8225808f7115 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:06 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698.info Sep 05 11:53:06 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:07 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c9b0a099-449e-4134-93bb-8225808f7115 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698.info" returned: 0 in 0.264s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:07 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-c9b0a099-449e-4134-93bb-8225808f7115 tempest-ProjectMemberTests-1275208846 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698.info is being set with open permissions: ugo+rw Sep 05 11:53:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c9b0a099-449e-4134-93bb-8225808f7115 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:07 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698.info Sep 05 11:53:07 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:07 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-c9b0a099-449e-4134-93bb-8225808f7115 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698.info" returned: 0 in 0.263s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-c9b0a099-449e-4134-93bb-8225808f7115 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.925s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:53:07 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-c9b0a099-449e-4134-93bb-8225808f7115 tempest-ProjectMemberTests-1275208846 None] Create snapshot completed successfully Sep 05 11:53:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-60bd3ee2-7ef4-483b-a345-b778cf162b65 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-0a31d330-752b-41c2-a545-4007320fcfa3-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:53:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-60bd3ee2-7ef4-483b-a345-b778cf162b65 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-0a31d330-752b-41c2-a545-4007320fcfa3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:53:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-60bd3ee2-7ef4-483b-a345-b778cf162b65 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-quobyte-8be92971-bca1-4a44-b71d-767b8707d698" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:53:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-60bd3ee2-7ef4-483b-a345-b778cf162b65 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-8be92971-bca1-4a44-b71d-767b8707d698" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:53:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-60bd3ee2-7ef4-483b-a345-b778cf162b65 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-quobyte-0a31d330-752b-41c2-a545-4007320fcfa3" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:53:07 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-60bd3ee2-7ef4-483b-a345-b778cf162b65 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-0a31d330-752b-41c2-a545-4007320fcfa3" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:53:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-60bd3ee2-7ef4-483b-a345-b778cf162b65 tempest-ProjectMemberTests-1275208846 None] Deleting offline snapshot 0a31d330-752b-41c2-a545-4007320fcfa3 of volume 8be92971-bca1-4a44-b71d-767b8707d698 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:53:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-60bd3ee2-7ef4-483b-a345-b778cf162b65 tempest-ProjectMemberTests-1275208846 None] snapshot_file for this snap is: volume-8be92971-bca1-4a44-b71d-767b8707d698.0a31d330-752b-41c2-a545-4007320fcfa3 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:53:07 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e8cd24-f803-4547-8ea1-c5008ddc0af0]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:53:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60bd3ee2-7ef4-483b-a345-b778cf162b65 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698.0a31d330-752b-41c2-a545-4007320fcfa3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:07 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698.0a31d330-752b-41c2-a545-4007320fcfa3 Sep 05 11:53:07 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:07 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:07 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60bd3ee2-7ef4-483b-a345-b778cf162b65 tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698.0a31d330-752b-41c2-a545-4007320fcfa3" returned: 0 in 0.360s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:07 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-60bd3ee2-7ef4-483b-a345-b778cf162b65 tempest-ProjectMemberTests-1275208846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8be92971-bca1-4a44-b71d-767b8707d698(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:53:08 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9553b0a-61df-4503-a8cd-98cfe42e62e8]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:53:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60bd3ee2-7ef4-483b-a345-b778cf162b65 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:08 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698 Sep 05 11:53:08 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:08 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60bd3ee2-7ef4-483b-a345-b778cf162b65 tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698" returned: 0 in 0.342s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60bd3ee2-7ef4-483b-a345-b778cf162b65 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698.0a31d330-752b-41c2-a545-4007320fcfa3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:08 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698.0a31d330-752b-41c2-a545-4007320fcfa3 Sep 05 11:53:08 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:08 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60bd3ee2-7ef4-483b-a345-b778cf162b65 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698.0a31d330-752b-41c2-a545-4007320fcfa3" returned: 0 in 0.362s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60bd3ee2-7ef4-483b-a345-b778cf162b65 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698.0a31d330-752b-41c2-a545-4007320fcfa3 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:08 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698.0a31d330-752b-41c2-a545-4007320fcfa3 Sep 05 11:53:08 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:08 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:08 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-60bd3ee2-7ef4-483b-a345-b778cf162b65 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698.0a31d330-752b-41c2-a545-4007320fcfa3" returned: 0 in 0.270s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-60bd3ee2-7ef4-483b-a345-b778cf162b65 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-0a31d330-752b-41c2-a545-4007320fcfa3" released by "_delete_snapshot" :: held 1.431s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:53:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-60bd3ee2-7ef4-483b-a345-b778cf162b65 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-8be92971-bca1-4a44-b71d-767b8707d698" released by "delete_snapshot" :: held 1.462s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:53:09 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-60bd3ee2-7ef4-483b-a345-b778cf162b65 tempest-ProjectMemberTests-1275208846 None] Created reservations ['d221d134-c4c7-4e80-aaa3-8f06cfd9d32b', '471ee36a-8f6b-4096-bcc9-45039df601a7', '5721c3d0-7c9a-40c3-83b3-c079648910d2', 'a526b7cc-b010-439f-a241-478c9708ca31'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:53:09 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-60bd3ee2-7ef4-483b-a345-b778cf162b65 tempest-ProjectMemberTests-1275208846 None] Delete snapshot completed successfully. Sep 05 11:53:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-60bd3ee2-7ef4-483b-a345-b778cf162b65 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-0a31d330-752b-41c2-a545-4007320fcfa3-delete_snapshot" released by "delete_snapshot" :: held 1.616s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:53:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-eca96956-72ba-468d-8063-824fa755a517 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-8be92971-bca1-4a44-b71d-767b8707d698-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:53:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-eca96956-72ba-468d-8063-824fa755a517 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-8be92971-bca1-4a44-b71d-767b8707d698-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:53:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-eca96956-72ba-468d-8063-824fa755a517 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-quobyte-8be92971-bca1-4a44-b71d-767b8707d698" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:53:09 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-eca96956-72ba-468d-8063-824fa755a517 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-8be92971-bca1-4a44-b71d-767b8707d698" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:53:09 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed23281-4862-4ab5-9f7c-7276e95ff2d8]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:53:09 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eca96956-72ba-468d-8063-824fa755a517 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:09 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698 Sep 05 11:53:09 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:10 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eca96956-72ba-468d-8063-824fa755a517 tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698" returned: 0 in 0.403s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eca96956-72ba-468d-8063-824fa755a517 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:10 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698 Sep 05 11:53:10 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:10 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eca96956-72ba-468d-8063-824fa755a517 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-8be92971-bca1-4a44-b71d-767b8707d698" returned: 0 in 0.260s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-eca96956-72ba-468d-8063-824fa755a517 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-8be92971-bca1-4a44-b71d-767b8707d698" released by "delete_volume" :: held 0.725s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:53:10 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-eca96956-72ba-468d-8063-824fa755a517 tempest-ProjectMemberTests-1275208846 None] Created reservations ['811cad96-8d2b-4286-8bcb-3406fc00e682', '9a503dd3-b3f7-47fd-b234-2d10f73665ec', 'b11266d4-7364-4900-a494-60f174aa84a6', '126f7e7e-64b5-4e1b-8175-9959679eab66'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:53:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-eca96956-72ba-468d-8063-824fa755a517 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:53:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-eca96956-72ba-468d-8063-824fa755a517 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:53:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-eca96956-72ba-468d-8063-824fa755a517 tempest-ProjectMemberTests-1275208846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:53:10 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-eca96956-72ba-468d-8063-824fa755a517 tempest-ProjectMemberTests-1275208846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:53:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-eca96956-72ba-468d-8063-824fa755a517 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:53:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eca96956-72ba-468d-8063-824fa755a517 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:10 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:53:10 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:10 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:10 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-eca96956-72ba-468d-8063-824fa755a517 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.260s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:10 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-eca96956-72ba-468d-8063-824fa755a517 tempest-ProjectMemberTests-1275208846 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:53:10 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-eca96956-72ba-468d-8063-824fa755a517 tempest-ProjectMemberTests-1275208846 None] Deleted volume successfully. Sep 05 11:53:10 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-eca96956-72ba-468d-8063-824fa755a517 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-8be92971-bca1-4a44-b71d-767b8707d698-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:53:11 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:53:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] Flow 'volume_create_manager' (da542af4-82c0-42ca-81a3-9e8643da8148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:53:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f21575f0-cdd1-41e0-91cf-e2d9f866be18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:53:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f21575f0-cdd1-41e0-91cf-e2d9f866be18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-166035930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3652d8c6-146c-476f-b61c-057fff4d0ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47eb7f5800ca42a8aac1df1019b50492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:53:11Z,use_quota=True,user_id='4498bbe7acb84612bf0e189659c0581e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:53:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6849b5d8-b5fc-477c-a972-d7577c91b97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:53:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6849b5d8-b5fc-477c-a972-d7577c91b97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:53:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09718e10-bb29-4c9d-9db3-004b399e00f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:53:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09718e10-bb29-4c9d-9db3-004b399e00f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3652d8c6-146c-476f-b61c-057fff4d0ca5', 'volume_name': 'volume-3652d8c6-146c-476f-b61c-057fff4d0ca5', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:53:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbc70a9b-cd5b-4de7-aad1-41550c3e0d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:53:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbc70a9b-cd5b-4de7-aad1-41550c3e0d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:53:11 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f6fab6c-50d8-4c2c-bc1e-01cd8c9cba06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:53:11 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] Volume 3652d8c6-146c-476f-b61c-057fff4d0ca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3652d8c6-146c-476f-b61c-057fff4d0ca5', 'volume_size': 1} Sep 05 11:53:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:53:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:53:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-166035930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3652d8c6-146c-476f-b61c-057fff4d0ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47eb7f5800ca42a8aac1df1019b50492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:53:11Z,use_quota=True,user_id='4498bbe7acb84612bf0e189659c0581e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:53:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] Creating volume 3652d8c6-146c-476f-b61c-057fff4d0ca5 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:53:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:53:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:53:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:53:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:53:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:53:11 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:53:11 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:53:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:11 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5 1073741824 Sep 05 11:53:11 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:11 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5 1073741824" returned: 0 in 0.401s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:11 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:11 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5 Sep 05 11:53:11 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:12 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5" returned: 0 in 0.241s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:53:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:53:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f6fab6c-50d8-4c2c-bc1e-01cd8c9cba06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3652d8c6-146c-476f-b61c-057fff4d0ca5', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:53:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efce7be7-a96f-449f-8880-a41fbc491420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:53:12 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] Volume volume-3652d8c6-146c-476f-b61c-057fff4d0ca5 (3652d8c6-146c-476f-b61c-057fff4d0ca5): created successfully Sep 05 11:53:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efce7be7-a96f-449f-8880-a41fbc491420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:53:12 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] Flow 'volume_create_manager' (da542af4-82c0-42ca-81a3-9e8643da8148) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:53:12 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-2f8a3912-2523-451e-bf0d-280b54aef181 tempest-ProjectMemberTests-1275208846 None] Created volume successfully. Sep 05 11:53:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-545adc22-836c-4812-9787-7b487799f3fe tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:53:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-545adc22-836c-4812-9787-7b487799f3fe tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:53:12 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-545adc22-836c-4812-9787-7b487799f3fe tempest-ProjectMemberTests-1275208846 None] Creating offline snapshot c09df305-6bb9-4165-88cb-10aedae4a35d of volume 3652d8c6-146c-476f-b61c-057fff4d0ca5 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:53:12 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6545de-ce13-4087-ac13-1fa8bb58216a]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:53:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-545adc22-836c-4812-9787-7b487799f3fe tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:12 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5 Sep 05 11:53:12 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:12 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-545adc22-836c-4812-9787-7b487799f3fe tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5" returned: 0 in 0.351s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:12 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-545adc22-836c-4812-9787-7b487799f3fe tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5.c09df305-6bb9-4165-88cb-10aedae4a35d 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:12 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5.c09df305-6bb9-4165-88cb-10aedae4a35d 1G Sep 05 11:53:12 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:13 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-545adc22-836c-4812-9787-7b487799f3fe tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5.c09df305-6bb9-4165-88cb-10aedae4a35d 1G" returned: 0 in 0.391s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-545adc22-836c-4812-9787-7b487799f3fe tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3652d8c6-146c-476f-b61c-057fff4d0ca5 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5.c09df305-6bb9-4165-88cb-10aedae4a35d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:13 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3652d8c6-146c-476f-b61c-057fff4d0ca5 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5.c09df305-6bb9-4165-88cb-10aedae4a35d Sep 05 11:53:13 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:13 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-545adc22-836c-4812-9787-7b487799f3fe tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3652d8c6-146c-476f-b61c-057fff4d0ca5 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5.c09df305-6bb9-4165-88cb-10aedae4a35d" returned: 0 in 0.289s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:13 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-545adc22-836c-4812-9787-7b487799f3fe tempest-ProjectMemberTests-1275208846 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5.c09df305-6bb9-4165-88cb-10aedae4a35d is being set with open permissions: ugo+rw Sep 05 11:53:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-545adc22-836c-4812-9787-7b487799f3fe tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5.c09df305-6bb9-4165-88cb-10aedae4a35d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:13 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5.c09df305-6bb9-4165-88cb-10aedae4a35d Sep 05 11:53:13 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:13 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-545adc22-836c-4812-9787-7b487799f3fe tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5.c09df305-6bb9-4165-88cb-10aedae4a35d" returned: 0 in 0.244s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:13 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-545adc22-836c-4812-9787-7b487799f3fe tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:13 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5.info Sep 05 11:53:13 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:14 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-545adc22-836c-4812-9787-7b487799f3fe tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5.info" returned: 0 in 0.260s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:14 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-545adc22-836c-4812-9787-7b487799f3fe tempest-ProjectMemberTests-1275208846 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5.info is being set with open permissions: ugo+rw Sep 05 11:53:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-545adc22-836c-4812-9787-7b487799f3fe tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:14 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5.info Sep 05 11:53:14 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:14 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-545adc22-836c-4812-9787-7b487799f3fe tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5.info" returned: 0 in 0.244s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-545adc22-836c-4812-9787-7b487799f3fe tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.852s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:53:14 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-545adc22-836c-4812-9787-7b487799f3fe tempest-ProjectMemberTests-1275208846 None] Create snapshot completed successfully Sep 05 11:53:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a1ec17b5-7f70-4ef9-87b5-76732342a6a3 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-c09df305-6bb9-4165-88cb-10aedae4a35d-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:53:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a1ec17b5-7f70-4ef9-87b5-76732342a6a3 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-c09df305-6bb9-4165-88cb-10aedae4a35d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:53:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a1ec17b5-7f70-4ef9-87b5-76732342a6a3 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-quobyte-3652d8c6-146c-476f-b61c-057fff4d0ca5" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:53:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a1ec17b5-7f70-4ef9-87b5-76732342a6a3 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-3652d8c6-146c-476f-b61c-057fff4d0ca5" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:53:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a1ec17b5-7f70-4ef9-87b5-76732342a6a3 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-quobyte-c09df305-6bb9-4165-88cb-10aedae4a35d" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:53:14 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a1ec17b5-7f70-4ef9-87b5-76732342a6a3 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-c09df305-6bb9-4165-88cb-10aedae4a35d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:53:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-a1ec17b5-7f70-4ef9-87b5-76732342a6a3 tempest-ProjectMemberTests-1275208846 None] Deleting offline snapshot c09df305-6bb9-4165-88cb-10aedae4a35d of volume 3652d8c6-146c-476f-b61c-057fff4d0ca5 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:53:14 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-a1ec17b5-7f70-4ef9-87b5-76732342a6a3 tempest-ProjectMemberTests-1275208846 None] snapshot_file for this snap is: volume-3652d8c6-146c-476f-b61c-057fff4d0ca5.c09df305-6bb9-4165-88cb-10aedae4a35d {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:53:14 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d994b23-33fe-42ea-8d6e-1d53f3756350]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:53:14 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a1ec17b5-7f70-4ef9-87b5-76732342a6a3 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5.c09df305-6bb9-4165-88cb-10aedae4a35d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:14 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5.c09df305-6bb9-4165-88cb-10aedae4a35d Sep 05 11:53:14 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:15 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a1ec17b5-7f70-4ef9-87b5-76732342a6a3 tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5.c09df305-6bb9-4165-88cb-10aedae4a35d" returned: 0 in 0.353s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:15 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-a1ec17b5-7f70-4ef9-87b5-76732342a6a3 tempest-ProjectMemberTests-1275208846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3652d8c6-146c-476f-b61c-057fff4d0ca5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:53:15 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56a8a8f-719f-433f-80eb-45a46d502fb9]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:53:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a1ec17b5-7f70-4ef9-87b5-76732342a6a3 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:15 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5 Sep 05 11:53:15 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:15 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a1ec17b5-7f70-4ef9-87b5-76732342a6a3 tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5" returned: 0 in 0.354s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a1ec17b5-7f70-4ef9-87b5-76732342a6a3 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5.c09df305-6bb9-4165-88cb-10aedae4a35d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:15 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5.c09df305-6bb9-4165-88cb-10aedae4a35d Sep 05 11:53:15 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:15 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a1ec17b5-7f70-4ef9-87b5-76732342a6a3 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5.c09df305-6bb9-4165-88cb-10aedae4a35d" returned: 0 in 0.330s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a1ec17b5-7f70-4ef9-87b5-76732342a6a3 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5.c09df305-6bb9-4165-88cb-10aedae4a35d {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:15 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5.c09df305-6bb9-4165-88cb-10aedae4a35d Sep 05 11:53:15 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:15 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:15 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-a1ec17b5-7f70-4ef9-87b5-76732342a6a3 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5.c09df305-6bb9-4165-88cb-10aedae4a35d" returned: 0 in 0.243s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:15 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a1ec17b5-7f70-4ef9-87b5-76732342a6a3 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-c09df305-6bb9-4165-88cb-10aedae4a35d" released by "_delete_snapshot" :: held 1.364s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:53:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a1ec17b5-7f70-4ef9-87b5-76732342a6a3 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-3652d8c6-146c-476f-b61c-057fff4d0ca5" released by "delete_snapshot" :: held 1.389s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:53:16 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-a1ec17b5-7f70-4ef9-87b5-76732342a6a3 tempest-ProjectMemberTests-1275208846 None] Created reservations ['6cc86bc0-8b84-4d50-a746-92fda958e17f', 'fe219b9a-d501-4076-bd4d-d3ac1f153ba9', '6f016ca7-acf4-4b74-a499-b379ef067d59', '80560e91-eddb-4517-98cd-7a87aa98ec9e'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:53:16 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-a1ec17b5-7f70-4ef9-87b5-76732342a6a3 tempest-ProjectMemberTests-1275208846 None] Delete snapshot completed successfully. Sep 05 11:53:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-a1ec17b5-7f70-4ef9-87b5-76732342a6a3 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-c09df305-6bb9-4165-88cb-10aedae4a35d-delete_snapshot" released by "delete_snapshot" :: held 1.512s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:53:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b5818eff-2599-406b-9a05-f23453f9130d tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-3652d8c6-146c-476f-b61c-057fff4d0ca5-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:53:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b5818eff-2599-406b-9a05-f23453f9130d tempest-ProjectMemberTests-1275208846 None] Lock "cinder-3652d8c6-146c-476f-b61c-057fff4d0ca5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:53:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b5818eff-2599-406b-9a05-f23453f9130d tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-quobyte-3652d8c6-146c-476f-b61c-057fff4d0ca5" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:53:16 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b5818eff-2599-406b-9a05-f23453f9130d tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-3652d8c6-146c-476f-b61c-057fff4d0ca5" acquired by "delete_volume" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:53:16 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8f05d3-b702-43fe-b277-78d9e2ddc407]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:53:16 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5818eff-2599-406b-9a05-f23453f9130d tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:16 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5 Sep 05 11:53:16 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:17 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5818eff-2599-406b-9a05-f23453f9130d tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5" returned: 0 in 0.355s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5818eff-2599-406b-9a05-f23453f9130d tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:17 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5 Sep 05 11:53:17 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:17 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5818eff-2599-406b-9a05-f23453f9130d tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-3652d8c6-146c-476f-b61c-057fff4d0ca5" returned: 0 in 0.242s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b5818eff-2599-406b-9a05-f23453f9130d tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-3652d8c6-146c-476f-b61c-057fff4d0ca5" released by "delete_volume" :: held 0.649s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:53:17 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-b5818eff-2599-406b-9a05-f23453f9130d tempest-ProjectMemberTests-1275208846 None] Created reservations ['d6966dcf-8e0a-4617-8804-c3c667a6a5c8', 'c71679df-60d8-4ce4-9fef-e431b5e152d0', 'ef8478b6-5fa0-4bef-b96e-586df711068a', '6f423d50-e32d-4744-9e70-bdca81a87c0a'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:53:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b5818eff-2599-406b-9a05-f23453f9130d tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:53:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b5818eff-2599-406b-9a05-f23453f9130d tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:53:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b5818eff-2599-406b-9a05-f23453f9130d tempest-ProjectMemberTests-1275208846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:53:17 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-b5818eff-2599-406b-9a05-f23453f9130d tempest-ProjectMemberTests-1275208846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:53:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-b5818eff-2599-406b-9a05-f23453f9130d tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:53:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5818eff-2599-406b-9a05-f23453f9130d tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:17 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:53:17 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:17 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:17 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-b5818eff-2599-406b-9a05-f23453f9130d tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.240s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:17 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-b5818eff-2599-406b-9a05-f23453f9130d tempest-ProjectMemberTests-1275208846 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:53:17 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-b5818eff-2599-406b-9a05-f23453f9130d tempest-ProjectMemberTests-1275208846 None] Deleted volume successfully. Sep 05 11:53:17 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-b5818eff-2599-406b-9a05-f23453f9130d tempest-ProjectMemberTests-1275208846 None] Lock "cinder-3652d8c6-146c-476f-b61c-057fff4d0ca5-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:53:18 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:53:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] Flow 'volume_create_manager' (e42a4068-db34-4493-b1a7-c5d53c4fa4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:53:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53842c40-e863-4df3-817d-cfe421435a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:53:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53842c40-e863-4df3-817d-cfe421435a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-742729676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20f56892-b63c-46e6-817b-c32444a9fc01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47eb7f5800ca42a8aac1df1019b50492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:53:18Z,use_quota=True,user_id='4498bbe7acb84612bf0e189659c0581e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:53:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a63c8074-2493-48f0-9ddf-5179f2e3c781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:53:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a63c8074-2493-48f0-9ddf-5179f2e3c781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:53:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8993bb1-c0e0-41ea-a962-38b2301eb3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:53:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8993bb1-c0e0-41ea-a962-38b2301eb3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20f56892-b63c-46e6-817b-c32444a9fc01', 'volume_name': 'volume-20f56892-b63c-46e6-817b-c32444a9fc01', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:53:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09bc7359-488f-442b-9720-18edffab95ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:53:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09bc7359-488f-442b-9720-18edffab95ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:53:18 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54443766-9492-49b8-ba5f-f4dbfb381a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:53:18 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] Volume 20f56892-b63c-46e6-817b-c32444a9fc01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20f56892-b63c-46e6-817b-c32444a9fc01', 'volume_size': 1} Sep 05 11:53:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:53:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:53:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-742729676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20f56892-b63c-46e6-817b-c32444a9fc01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47eb7f5800ca42a8aac1df1019b50492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:53:18Z,use_quota=True,user_id='4498bbe7acb84612bf0e189659c0581e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:53:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] Creating volume 20f56892-b63c-46e6-817b-c32444a9fc01 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:53:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:53:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:53:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:53:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:53:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:53:18 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:53:18 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:53:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:18 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01 1073741824 Sep 05 11:53:18 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:18 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01 1073741824" returned: 0 in 0.381s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:18 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:18 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01 Sep 05 11:53:18 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:19 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01" returned: 0 in 0.241s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] <== create_volume: return (663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:53:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.667s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:53:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54443766-9492-49b8-ba5f-f4dbfb381a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20f56892-b63c-46e6-817b-c32444a9fc01', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:53:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552a735b-a220-47f7-ac6c-71de3d44c496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:53:19 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] Volume volume-20f56892-b63c-46e6-817b-c32444a9fc01 (20f56892-b63c-46e6-817b-c32444a9fc01): created successfully Sep 05 11:53:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552a735b-a220-47f7-ac6c-71de3d44c496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:53:19 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] Flow 'volume_create_manager' (e42a4068-db34-4493-b1a7-c5d53c4fa4f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:53:19 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-5f252b80-b31f-4b3c-b350-3d9169f63df3 tempest-ProjectMemberTests-1275208846 None] Created volume successfully. Sep 05 11:53:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-413f88ce-7231-4935-b031-f5d63d8a43fc tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:53:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-413f88ce-7231-4935-b031-f5d63d8a43fc tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:53:19 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-413f88ce-7231-4935-b031-f5d63d8a43fc tempest-ProjectMemberTests-1275208846 None] Creating offline snapshot 44c7d3c6-59d1-49de-952f-d69a5df4517e of volume 20f56892-b63c-46e6-817b-c32444a9fc01 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:53:19 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a1ad1f-b49a-4474-9ed8-d546170f9926]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:53:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-413f88ce-7231-4935-b031-f5d63d8a43fc tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:19 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01 Sep 05 11:53:19 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:19 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-413f88ce-7231-4935-b031-f5d63d8a43fc tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01" returned: 0 in 0.344s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:19 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-413f88ce-7231-4935-b031-f5d63d8a43fc tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01.44c7d3c6-59d1-49de-952f-d69a5df4517e 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:19 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01.44c7d3c6-59d1-49de-952f-d69a5df4517e 1G Sep 05 11:53:19 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:20 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-413f88ce-7231-4935-b031-f5d63d8a43fc tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01.44c7d3c6-59d1-49de-952f-d69a5df4517e 1G" returned: 0 in 0.375s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-413f88ce-7231-4935-b031-f5d63d8a43fc tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20f56892-b63c-46e6-817b-c32444a9fc01 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01.44c7d3c6-59d1-49de-952f-d69a5df4517e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:20 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20f56892-b63c-46e6-817b-c32444a9fc01 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01.44c7d3c6-59d1-49de-952f-d69a5df4517e Sep 05 11:53:20 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:20 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-413f88ce-7231-4935-b031-f5d63d8a43fc tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20f56892-b63c-46e6-817b-c32444a9fc01 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01.44c7d3c6-59d1-49de-952f-d69a5df4517e" returned: 0 in 0.287s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:20 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-413f88ce-7231-4935-b031-f5d63d8a43fc tempest-ProjectMemberTests-1275208846 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01.44c7d3c6-59d1-49de-952f-d69a5df4517e is being set with open permissions: ugo+rw Sep 05 11:53:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-413f88ce-7231-4935-b031-f5d63d8a43fc tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01.44c7d3c6-59d1-49de-952f-d69a5df4517e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:20 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01.44c7d3c6-59d1-49de-952f-d69a5df4517e Sep 05 11:53:20 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:20 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-413f88ce-7231-4935-b031-f5d63d8a43fc tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01.44c7d3c6-59d1-49de-952f-d69a5df4517e" returned: 0 in 0.242s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:20 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-413f88ce-7231-4935-b031-f5d63d8a43fc tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:20 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01.info Sep 05 11:53:20 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:21 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-413f88ce-7231-4935-b031-f5d63d8a43fc tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01.info" returned: 0 in 0.241s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:21 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-413f88ce-7231-4935-b031-f5d63d8a43fc tempest-ProjectMemberTests-1275208846 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01.info is being set with open permissions: ugo+rw Sep 05 11:53:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-413f88ce-7231-4935-b031-f5d63d8a43fc tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:21 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01.info Sep 05 11:53:21 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:21 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-413f88ce-7231-4935-b031-f5d63d8a43fc tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01.info" returned: 0 in 0.249s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-413f88ce-7231-4935-b031-f5d63d8a43fc tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.810s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:53:21 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-413f88ce-7231-4935-b031-f5d63d8a43fc tempest-ProjectMemberTests-1275208846 None] Create snapshot completed successfully Sep 05 11:53:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-02e05ed8-72ee-42cb-877a-f84ff8a0f6fe tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-44c7d3c6-59d1-49de-952f-d69a5df4517e-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:53:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-02e05ed8-72ee-42cb-877a-f84ff8a0f6fe tempest-ProjectMemberTests-1275208846 None] Lock "cinder-44c7d3c6-59d1-49de-952f-d69a5df4517e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:53:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-02e05ed8-72ee-42cb-877a-f84ff8a0f6fe tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-quobyte-20f56892-b63c-46e6-817b-c32444a9fc01" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:53:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-02e05ed8-72ee-42cb-877a-f84ff8a0f6fe tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-20f56892-b63c-46e6-817b-c32444a9fc01" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:53:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-02e05ed8-72ee-42cb-877a-f84ff8a0f6fe tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-quobyte-44c7d3c6-59d1-49de-952f-d69a5df4517e" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:53:21 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-02e05ed8-72ee-42cb-877a-f84ff8a0f6fe tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-44c7d3c6-59d1-49de-952f-d69a5df4517e" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:53:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-02e05ed8-72ee-42cb-877a-f84ff8a0f6fe tempest-ProjectMemberTests-1275208846 None] Deleting offline snapshot 44c7d3c6-59d1-49de-952f-d69a5df4517e of volume 20f56892-b63c-46e6-817b-c32444a9fc01 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:53:21 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-02e05ed8-72ee-42cb-877a-f84ff8a0f6fe tempest-ProjectMemberTests-1275208846 None] snapshot_file for this snap is: volume-20f56892-b63c-46e6-817b-c32444a9fc01.44c7d3c6-59d1-49de-952f-d69a5df4517e {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:53:21 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[19056960-66ea-4f73-8350-5a01efe5fbfc]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:53:21 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-02e05ed8-72ee-42cb-877a-f84ff8a0f6fe tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01.44c7d3c6-59d1-49de-952f-d69a5df4517e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:21 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01.44c7d3c6-59d1-49de-952f-d69a5df4517e Sep 05 11:53:21 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:22 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-02e05ed8-72ee-42cb-877a-f84ff8a0f6fe tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01.44c7d3c6-59d1-49de-952f-d69a5df4517e" returned: 0 in 0.358s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:22 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-02e05ed8-72ee-42cb-877a-f84ff8a0f6fe tempest-ProjectMemberTests-1275208846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20f56892-b63c-46e6-817b-c32444a9fc01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:53:22 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadc8a77-3a74-4f9f-a486-69e5506a22f8]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:53:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-02e05ed8-72ee-42cb-877a-f84ff8a0f6fe tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:22 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01 Sep 05 11:53:22 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:22 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-02e05ed8-72ee-42cb-877a-f84ff8a0f6fe tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01" returned: 0 in 0.342s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-02e05ed8-72ee-42cb-877a-f84ff8a0f6fe tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01.44c7d3c6-59d1-49de-952f-d69a5df4517e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:22 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01.44c7d3c6-59d1-49de-952f-d69a5df4517e Sep 05 11:53:22 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:22 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-02e05ed8-72ee-42cb-877a-f84ff8a0f6fe tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01.44c7d3c6-59d1-49de-952f-d69a5df4517e" returned: 0 in 0.321s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-02e05ed8-72ee-42cb-877a-f84ff8a0f6fe tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01.44c7d3c6-59d1-49de-952f-d69a5df4517e {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:22 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01.44c7d3c6-59d1-49de-952f-d69a5df4517e Sep 05 11:53:22 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:22 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:22 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-02e05ed8-72ee-42cb-877a-f84ff8a0f6fe tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01.44c7d3c6-59d1-49de-952f-d69a5df4517e" returned: 0 in 0.246s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-02e05ed8-72ee-42cb-877a-f84ff8a0f6fe tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-44c7d3c6-59d1-49de-952f-d69a5df4517e" released by "_delete_snapshot" :: held 1.346s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:53:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-02e05ed8-72ee-42cb-877a-f84ff8a0f6fe tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-20f56892-b63c-46e6-817b-c32444a9fc01" released by "delete_snapshot" :: held 1.365s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:53:23 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-02e05ed8-72ee-42cb-877a-f84ff8a0f6fe tempest-ProjectMemberTests-1275208846 None] Created reservations ['aedfbd5f-f0fe-4f6f-ab77-2f9a3c2ee772', '06f02e0e-1d92-4649-a525-b6d055a4d4e3', 'a35712f3-8aa6-4bed-89ff-217ce0bbb776', 'c98ca3d2-1136-4a8a-83c1-77c2ae79b217'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:53:23 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-02e05ed8-72ee-42cb-877a-f84ff8a0f6fe tempest-ProjectMemberTests-1275208846 None] Delete snapshot completed successfully. Sep 05 11:53:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-02e05ed8-72ee-42cb-877a-f84ff8a0f6fe tempest-ProjectMemberTests-1275208846 None] Lock "cinder-44c7d3c6-59d1-49de-952f-d69a5df4517e-delete_snapshot" released by "delete_snapshot" :: held 1.488s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:53:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-96853df5-a5e0-4774-a644-e1c7c08a64de tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-20f56892-b63c-46e6-817b-c32444a9fc01-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:53:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-96853df5-a5e0-4774-a644-e1c7c08a64de tempest-ProjectMemberTests-1275208846 None] Lock "cinder-20f56892-b63c-46e6-817b-c32444a9fc01-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:53:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-96853df5-a5e0-4774-a644-e1c7c08a64de tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-quobyte-20f56892-b63c-46e6-817b-c32444a9fc01" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:53:23 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-96853df5-a5e0-4774-a644-e1c7c08a64de tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-20f56892-b63c-46e6-817b-c32444a9fc01" acquired by "delete_volume" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:53:23 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d78c700-a937-4e5a-b5c6-7e8d610fdedf]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:53:23 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-96853df5-a5e0-4774-a644-e1c7c08a64de tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:23 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01 Sep 05 11:53:23 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:24 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-96853df5-a5e0-4774-a644-e1c7c08a64de tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01" returned: 0 in 0.352s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-96853df5-a5e0-4774-a644-e1c7c08a64de tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:24 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01 Sep 05 11:53:24 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:24 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-96853df5-a5e0-4774-a644-e1c7c08a64de tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-20f56892-b63c-46e6-817b-c32444a9fc01" returned: 0 in 0.234s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-96853df5-a5e0-4774-a644-e1c7c08a64de tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-20f56892-b63c-46e6-817b-c32444a9fc01" released by "delete_volume" :: held 0.635s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:53:24 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-96853df5-a5e0-4774-a644-e1c7c08a64de tempest-ProjectMemberTests-1275208846 None] Created reservations ['8804851d-9d69-4928-873a-b3fd9cf175a8', '58cea716-72dc-4071-8fc8-0febf2ed4ea1', 'b5547d27-9d4c-49a4-8b3f-dd89f5ffae43', '06030e1d-aa1b-4346-96c1-29eb662ca765'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:53:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-96853df5-a5e0-4774-a644-e1c7c08a64de tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:53:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-96853df5-a5e0-4774-a644-e1c7c08a64de tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:53:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-96853df5-a5e0-4774-a644-e1c7c08a64de tempest-ProjectMemberTests-1275208846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:53:24 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-96853df5-a5e0-4774-a644-e1c7c08a64de tempest-ProjectMemberTests-1275208846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:53:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-96853df5-a5e0-4774-a644-e1c7c08a64de tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:53:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-96853df5-a5e0-4774-a644-e1c7c08a64de tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:24 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:53:24 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:24 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:24 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-96853df5-a5e0-4774-a644-e1c7c08a64de tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.232s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:24 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-96853df5-a5e0-4774-a644-e1c7c08a64de tempest-ProjectMemberTests-1275208846 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:53:24 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-96853df5-a5e0-4774-a644-e1c7c08a64de tempest-ProjectMemberTests-1275208846 None] Deleted volume successfully. Sep 05 11:53:24 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-96853df5-a5e0-4774-a644-e1c7c08a64de tempest-ProjectMemberTests-1275208846 None] Lock "cinder-20f56892-b63c-46e6-817b-c32444a9fc01-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:53:25 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:53:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] Flow 'volume_create_manager' (8b122231-1545-45be-8f44-de5e65678dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:53:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05e76e40-9ccd-411d-805f-9bb37a183204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:53:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05e76e40-9ccd-411d-805f-9bb37a183204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1347530788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47eb7f5800ca42a8aac1df1019b50492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:53:25Z,use_quota=True,user_id='4498bbe7acb84612bf0e189659c0581e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:53:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (960b216a-8ca1-4ada-a735-db7fc2668272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:53:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (960b216a-8ca1-4ada-a735-db7fc2668272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:53:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (711ef9d1-ef5a-4f75-b2dc-7ae67237f733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:53:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (711ef9d1-ef5a-4f75-b2dc-7ae67237f733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a', 'volume_name': 'volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:53:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740f3c92-0875-4dda-bcca-08382f61a5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:53:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740f3c92-0875-4dda-bcca-08382f61a5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:53:25 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bfc29a4-d1cf-4ee9-a8f2-682afae07f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:53:25 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] Volume 0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a', 'volume_size': 1} Sep 05 11:53:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:53:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:53:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1347530788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47eb7f5800ca42a8aac1df1019b50492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:53:25Z,use_quota=True,user_id='4498bbe7acb84612bf0e189659c0581e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:53:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] Creating volume 0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:53:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:53:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:53:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:53:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:53:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:53:25 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:53:25 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:53:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:25 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a 1073741824 Sep 05 11:53:25 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:25 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a 1073741824" returned: 0 in 0.407s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:25 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:25 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a Sep 05 11:53:25 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:26 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a" returned: 0 in 0.234s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:53:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:53:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bfc29a4-d1cf-4ee9-a8f2-682afae07f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:53:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (937738c4-d22e-4806-ae0b-f390cc42d392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:53:26 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] Volume volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a (0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a): created successfully Sep 05 11:53:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (937738c4-d22e-4806-ae0b-f390cc42d392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:53:26 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] Flow 'volume_create_manager' (8b122231-1545-45be-8f44-de5e65678dec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:53:26 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-5b6d8119-6428-4646-af9b-d45ca7ff3ea5 tempest-ProjectMemberTests-1275208846 None] Created volume successfully. Sep 05 11:53:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-41bc492f-55d1-4c0a-89e8-88d0d3ba58b5 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:53:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-41bc492f-55d1-4c0a-89e8-88d0d3ba58b5 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:53:26 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-41bc492f-55d1-4c0a-89e8-88d0d3ba58b5 tempest-ProjectMemberTests-1275208846 None] Creating offline snapshot 6b4cb55f-086a-4cfd-bf58-049caa4f5bc5 of volume 0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:53:26 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa40ea4-89a8-4a55-b4be-147011895c09]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:53:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-41bc492f-55d1-4c0a-89e8-88d0d3ba58b5 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:26 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a Sep 05 11:53:26 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:26 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-41bc492f-55d1-4c0a-89e8-88d0d3ba58b5 tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a" returned: 0 in 0.347s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:26 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-41bc492f-55d1-4c0a-89e8-88d0d3ba58b5 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a.6b4cb55f-086a-4cfd-bf58-049caa4f5bc5 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:26 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a.6b4cb55f-086a-4cfd-bf58-049caa4f5bc5 1G Sep 05 11:53:26 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:27 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-41bc492f-55d1-4c0a-89e8-88d0d3ba58b5 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a.6b4cb55f-086a-4cfd-bf58-049caa4f5bc5 1G" returned: 0 in 0.368s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-41bc492f-55d1-4c0a-89e8-88d0d3ba58b5 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a.6b4cb55f-086a-4cfd-bf58-049caa4f5bc5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:27 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a.6b4cb55f-086a-4cfd-bf58-049caa4f5bc5 Sep 05 11:53:27 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:27 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-41bc492f-55d1-4c0a-89e8-88d0d3ba58b5 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a.6b4cb55f-086a-4cfd-bf58-049caa4f5bc5" returned: 0 in 0.286s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:27 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-41bc492f-55d1-4c0a-89e8-88d0d3ba58b5 tempest-ProjectMemberTests-1275208846 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a.6b4cb55f-086a-4cfd-bf58-049caa4f5bc5 is being set with open permissions: ugo+rw Sep 05 11:53:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-41bc492f-55d1-4c0a-89e8-88d0d3ba58b5 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a.6b4cb55f-086a-4cfd-bf58-049caa4f5bc5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:27 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a.6b4cb55f-086a-4cfd-bf58-049caa4f5bc5 Sep 05 11:53:27 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:27 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-41bc492f-55d1-4c0a-89e8-88d0d3ba58b5 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a.6b4cb55f-086a-4cfd-bf58-049caa4f5bc5" returned: 0 in 0.240s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-41bc492f-55d1-4c0a-89e8-88d0d3ba58b5 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:27 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a.info Sep 05 11:53:27 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:27 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-41bc492f-55d1-4c0a-89e8-88d0d3ba58b5 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a.info" returned: 0 in 0.246s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:27 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-41bc492f-55d1-4c0a-89e8-88d0d3ba58b5 tempest-ProjectMemberTests-1275208846 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a.info is being set with open permissions: ugo+rw Sep 05 11:53:27 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-41bc492f-55d1-4c0a-89e8-88d0d3ba58b5 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:28 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a.info Sep 05 11:53:28 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:28 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-41bc492f-55d1-4c0a-89e8-88d0d3ba58b5 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a.info" returned: 0 in 0.232s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-41bc492f-55d1-4c0a-89e8-88d0d3ba58b5 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.786s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:53:28 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-41bc492f-55d1-4c0a-89e8-88d0d3ba58b5 tempest-ProjectMemberTests-1275208846 None] Create snapshot completed successfully Sep 05 11:53:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-619b5714-3ef1-4b2a-a34a-2020a5d697fe tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-6b4cb55f-086a-4cfd-bf58-049caa4f5bc5-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:53:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-619b5714-3ef1-4b2a-a34a-2020a5d697fe tempest-ProjectMemberTests-1275208846 None] Lock "cinder-6b4cb55f-086a-4cfd-bf58-049caa4f5bc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:53:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-619b5714-3ef1-4b2a-a34a-2020a5d697fe tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-quobyte-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:53:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-619b5714-3ef1-4b2a-a34a-2020a5d697fe tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:53:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-619b5714-3ef1-4b2a-a34a-2020a5d697fe tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-quobyte-6b4cb55f-086a-4cfd-bf58-049caa4f5bc5" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:53:28 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-619b5714-3ef1-4b2a-a34a-2020a5d697fe tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-6b4cb55f-086a-4cfd-bf58-049caa4f5bc5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:53:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-619b5714-3ef1-4b2a-a34a-2020a5d697fe tempest-ProjectMemberTests-1275208846 None] Deleting offline snapshot 6b4cb55f-086a-4cfd-bf58-049caa4f5bc5 of volume 0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:53:28 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-619b5714-3ef1-4b2a-a34a-2020a5d697fe tempest-ProjectMemberTests-1275208846 None] snapshot_file for this snap is: volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a.6b4cb55f-086a-4cfd-bf58-049caa4f5bc5 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:53:28 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24380f9-d0b9-4343-a4b2-a388b5e79a1c]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:53:28 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-619b5714-3ef1-4b2a-a34a-2020a5d697fe tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a.6b4cb55f-086a-4cfd-bf58-049caa4f5bc5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:28 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a.6b4cb55f-086a-4cfd-bf58-049caa4f5bc5 Sep 05 11:53:28 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:29 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-619b5714-3ef1-4b2a-a34a-2020a5d697fe tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a.6b4cb55f-086a-4cfd-bf58-049caa4f5bc5" returned: 0 in 0.347s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:29 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-619b5714-3ef1-4b2a-a34a-2020a5d697fe tempest-ProjectMemberTests-1275208846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:53:29 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[97482368-8bbf-473e-acfe-a21f72e93dcb]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:53:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-619b5714-3ef1-4b2a-a34a-2020a5d697fe tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:29 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a Sep 05 11:53:29 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:29 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-619b5714-3ef1-4b2a-a34a-2020a5d697fe tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a" returned: 0 in 0.335s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-619b5714-3ef1-4b2a-a34a-2020a5d697fe tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a.6b4cb55f-086a-4cfd-bf58-049caa4f5bc5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:29 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a.6b4cb55f-086a-4cfd-bf58-049caa4f5bc5 Sep 05 11:53:29 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:29 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-619b5714-3ef1-4b2a-a34a-2020a5d697fe tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a.6b4cb55f-086a-4cfd-bf58-049caa4f5bc5" returned: 0 in 0.317s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-619b5714-3ef1-4b2a-a34a-2020a5d697fe tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a.6b4cb55f-086a-4cfd-bf58-049caa4f5bc5 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:29 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a.6b4cb55f-086a-4cfd-bf58-049caa4f5bc5 Sep 05 11:53:29 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:29 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:29 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-619b5714-3ef1-4b2a-a34a-2020a5d697fe tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a.6b4cb55f-086a-4cfd-bf58-049caa4f5bc5" returned: 0 in 0.231s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-619b5714-3ef1-4b2a-a34a-2020a5d697fe tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-6b4cb55f-086a-4cfd-bf58-049caa4f5bc5" released by "_delete_snapshot" :: held 1.310s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:53:29 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-619b5714-3ef1-4b2a-a34a-2020a5d697fe tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a" released by "delete_snapshot" :: held 1.333s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:53:29 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-619b5714-3ef1-4b2a-a34a-2020a5d697fe tempest-ProjectMemberTests-1275208846 None] Created reservations ['08a80077-2ddf-4176-911f-8c16c7863176', 'f4ce2f11-9c2f-496b-b649-257b0a83139e', '9544f172-b00a-430f-9001-7327631797fd', '30092815-55e7-4a20-a0a0-540ea2327fab'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:53:30 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-619b5714-3ef1-4b2a-a34a-2020a5d697fe tempest-ProjectMemberTests-1275208846 None] Delete snapshot completed successfully. Sep 05 11:53:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-619b5714-3ef1-4b2a-a34a-2020a5d697fe tempest-ProjectMemberTests-1275208846 None] Lock "cinder-6b4cb55f-086a-4cfd-bf58-049caa4f5bc5-delete_snapshot" released by "delete_snapshot" :: held 1.454s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:53:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e0e54caf-bcf7-484d-b1f0-b5864e27f738 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:53:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e0e54caf-bcf7-484d-b1f0-b5864e27f738 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:53:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e0e54caf-bcf7-484d-b1f0-b5864e27f738 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-quobyte-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:53:30 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e0e54caf-bcf7-484d-b1f0-b5864e27f738 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a" acquired by "delete_volume" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:53:30 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7022ef5-ca75-4a00-aba9-d7e8571e3cc8]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:53:30 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e0e54caf-bcf7-484d-b1f0-b5864e27f738 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:30 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a Sep 05 11:53:30 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:31 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e0e54caf-bcf7-484d-b1f0-b5864e27f738 tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a" returned: 0 in 0.347s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e0e54caf-bcf7-484d-b1f0-b5864e27f738 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:31 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a Sep 05 11:53:31 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:31 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e0e54caf-bcf7-484d-b1f0-b5864e27f738 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a" returned: 0 in 0.230s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e0e54caf-bcf7-484d-b1f0-b5864e27f738 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a" released by "delete_volume" :: held 0.626s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:53:31 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-e0e54caf-bcf7-484d-b1f0-b5864e27f738 tempest-ProjectMemberTests-1275208846 None] Created reservations ['3e3df886-2168-4caa-99c5-2c282b44a35d', '2b1403b0-ba8b-4cb2-98a7-9f9342e04c6e', '4891e5b5-3701-4122-84ab-f35b5d4d999c', '13aeb0b2-0487-49aa-b6b0-3cd0a5321400'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:53:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e0e54caf-bcf7-484d-b1f0-b5864e27f738 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:53:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e0e54caf-bcf7-484d-b1f0-b5864e27f738 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:53:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e0e54caf-bcf7-484d-b1f0-b5864e27f738 tempest-ProjectMemberTests-1275208846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:53:31 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-e0e54caf-bcf7-484d-b1f0-b5864e27f738 tempest-ProjectMemberTests-1275208846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:53:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-e0e54caf-bcf7-484d-b1f0-b5864e27f738 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:53:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e0e54caf-bcf7-484d-b1f0-b5864e27f738 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:31 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:53:31 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:31 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:31 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-e0e54caf-bcf7-484d-b1f0-b5864e27f738 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.233s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:31 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-e0e54caf-bcf7-484d-b1f0-b5864e27f738 tempest-ProjectMemberTests-1275208846 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:53:31 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-e0e54caf-bcf7-484d-b1f0-b5864e27f738 tempest-ProjectMemberTests-1275208846 None] Deleted volume successfully. Sep 05 11:53:31 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-e0e54caf-bcf7-484d-b1f0-b5864e27f738 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-0ff0b10e-b65c-4af1-a0ff-46270f1d0c6a-delete_volume" released by "delete_volume" :: held 1.032s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG cinder.volume.flows.manager.create_volume [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 11:53:32 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:53:32 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] Flow 'volume_create_manager' (79f2ae41-9806-4ee5-b804-357df0b49240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca627257-e32d-468e-9b24-f28436e7116d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca627257-e32d-468e-9b24-f28436e7116d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1532313624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeff195d-a9dd-4888-86c7-91dabb804bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47eb7f5800ca42a8aac1df1019b50492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:53:32Z,use_quota=True,user_id='4498bbe7acb84612bf0e189659c0581e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3224f043-a71e-4e66-b0fa-454d99637f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3224f043-a71e-4e66-b0fa-454d99637f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6632a66f-aba7-406a-84fe-29a69ef7009c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6632a66f-aba7-406a-84fe-29a69ef7009c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeff195d-a9dd-4888-86c7-91dabb804bb6', 'volume_name': 'volume-aeff195d-a9dd-4888-86c7-91dabb804bb6', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af88d0ac-e5b1-4578-9c05-85d93848969f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af88d0ac-e5b1-4578-9c05-85d93848969f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5adc2078-2f39-4cdb-818a-0465a54e58a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:53:32 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] Volume aeff195d-a9dd-4888-86c7-91dabb804bb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeff195d-a9dd-4888-86c7-91dabb804bb6', 'volume_size': 1} Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T09:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1532313624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeff195d-a9dd-4888-86c7-91dabb804bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47eb7f5800ca42a8aac1df1019b50492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T09:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T09:53:32Z,use_quota=True,user_id='4498bbe7acb84612bf0e189659c0581e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(198b26c6-9af3-4856-b965-6405280c6013),volume_type_id=198b26c6-9af3-4856-b965-6405280c6013)}" {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] Creating volume aeff195d-a9dd-4888-86c7-91dabb804bb6 {{(pid=87517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] Selected osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 as target Quobyte volume. {{(pid=87517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 05 11:53:32 devstack cinder-volume[87517]: INFO cinder.volume.drivers.remotefs [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] casted to osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32 Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6 1073741824 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:32 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6 1073741824 Sep 05 11:53:32 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:32 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.249s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG oslo_service.periodic_task [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] Running periodic task VolumeManager._thread_info {{(pid=87517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread count: 28 {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-070cb422-c1d5-48a5-9874-a13914f8a018 None None] thread info: [<_MainThread(MainThread, started 131707869511808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 11:53:32 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6 1073741824" returned: 0 in 0.388s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:32 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:32 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6 Sep 05 11:53:32 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:33 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6" returned: 0 in 0.238s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] <== create_volume: return (663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'} {{(pid=87517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 11:53:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.665s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:53:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5adc2078-2f39-4cdb-818a-0465a54e58a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeff195d-a9dd-4888-86c7-91dabb804bb6', 'volume_size': 1}' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:53:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ac7b2ea-ce84-4d2e-905b-050bedfd59a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 11:53:33 devstack cinder-volume[87517]: INFO cinder.volume.flows.manager.create_volume [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] Volume volume-aeff195d-a9dd-4888-86c7-91dabb804bb6 (aeff195d-a9dd-4888-86c7-91dabb804bb6): created successfully Sep 05 11:53:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ac7b2ea-ce84-4d2e-905b-050bedfd59a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87517) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 11:53:33 devstack cinder-volume[87517]: DEBUG cinder.volume.manager [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] Flow 'volume_create_manager' (79f2ae41-9806-4ee5-b804-357df0b49240) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87517) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 11:53:33 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-611d2831-9cac-4450-8aaa-1f09a5bd9078 tempest-ProjectMemberTests-1275208846 None] Created volume successfully. Sep 05 11:53:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3ebd07ec-7779-44cf-be42-7d331a36635f tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:53:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3ebd07ec-7779-44cf-be42-7d331a36635f tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:53:33 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-3ebd07ec-7779-44cf-be42-7d331a36635f tempest-ProjectMemberTests-1275208846 None] Creating offline snapshot ebcb329d-ee25-49d9-b3e0-b415d21cff72 of volume aeff195d-a9dd-4888-86c7-91dabb804bb6 {{(pid=87517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 11:53:33 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70eb867-cf76-4c82-b9db-62db5bd66c5d]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:53:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3ebd07ec-7779-44cf-be42-7d331a36635f tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:33 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6 Sep 05 11:53:33 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:33 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3ebd07ec-7779-44cf-be42-7d331a36635f tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6" returned: 0 in 0.345s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:33 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3ebd07ec-7779-44cf-be42-7d331a36635f tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6.ebcb329d-ee25-49d9-b3e0-b415d21cff72 1G {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:33 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6.ebcb329d-ee25-49d9-b3e0-b415d21cff72 1G Sep 05 11:53:33 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:34 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3ebd07ec-7779-44cf-be42-7d331a36635f tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6.ebcb329d-ee25-49d9-b3e0-b415d21cff72 1G" returned: 0 in 0.368s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3ebd07ec-7779-44cf-be42-7d331a36635f tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeff195d-a9dd-4888-86c7-91dabb804bb6 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6.ebcb329d-ee25-49d9-b3e0-b415d21cff72 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:34 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeff195d-a9dd-4888-86c7-91dabb804bb6 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6.ebcb329d-ee25-49d9-b3e0-b415d21cff72 Sep 05 11:53:34 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:34 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3ebd07ec-7779-44cf-be42-7d331a36635f tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeff195d-a9dd-4888-86c7-91dabb804bb6 -F qcow2 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6.ebcb329d-ee25-49d9-b3e0-b415d21cff72" returned: 0 in 0.273s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:34 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-3ebd07ec-7779-44cf-be42-7d331a36635f tempest-ProjectMemberTests-1275208846 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6.ebcb329d-ee25-49d9-b3e0-b415d21cff72 is being set with open permissions: ugo+rw Sep 05 11:53:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3ebd07ec-7779-44cf-be42-7d331a36635f tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6.ebcb329d-ee25-49d9-b3e0-b415d21cff72 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:34 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6.ebcb329d-ee25-49d9-b3e0-b415d21cff72 Sep 05 11:53:34 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:34 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3ebd07ec-7779-44cf-be42-7d331a36635f tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6.ebcb329d-ee25-49d9-b3e0-b415d21cff72" returned: 0 in 0.231s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3ebd07ec-7779-44cf-be42-7d331a36635f tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:34 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6.info Sep 05 11:53:34 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:34 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3ebd07ec-7779-44cf-be42-7d331a36635f tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6.info" returned: 0 in 0.235s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:34 devstack cinder-volume[87517]: WARNING cinder.volume.drivers.remotefs [None req-3ebd07ec-7779-44cf-be42-7d331a36635f tempest-ProjectMemberTests-1275208846 None] /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6.info is being set with open permissions: ugo+rw Sep 05 11:53:34 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3ebd07ec-7779-44cf-be42-7d331a36635f tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6.info {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:34 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6.info Sep 05 11:53:34 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:35 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-3ebd07ec-7779-44cf-be42-7d331a36635f tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6.info" returned: 0 in 0.233s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-3ebd07ec-7779-44cf-be42-7d331a36635f tempest-ProjectMemberTests-1275208846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.753s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:53:35 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-3ebd07ec-7779-44cf-be42-7d331a36635f tempest-ProjectMemberTests-1275208846 None] Create snapshot completed successfully Sep 05 11:53:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d14b2664-4a00-450b-9528-4cf6d920c8e8 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-ebcb329d-ee25-49d9-b3e0-b415d21cff72-delete_snapshot" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:53:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d14b2664-4a00-450b-9528-4cf6d920c8e8 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-ebcb329d-ee25-49d9-b3e0-b415d21cff72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:53:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d14b2664-4a00-450b-9528-4cf6d920c8e8 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-quobyte-aeff195d-a9dd-4888-86c7-91dabb804bb6" by "delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:53:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d14b2664-4a00-450b-9528-4cf6d920c8e8 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-aeff195d-a9dd-4888-86c7-91dabb804bb6" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:53:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d14b2664-4a00-450b-9528-4cf6d920c8e8 tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-quobyte-ebcb329d-ee25-49d9-b3e0-b415d21cff72" by "_delete_snapshot" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:53:35 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d14b2664-4a00-450b-9528-4cf6d920c8e8 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-ebcb329d-ee25-49d9-b3e0-b415d21cff72" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:53:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-d14b2664-4a00-450b-9528-4cf6d920c8e8 tempest-ProjectMemberTests-1275208846 None] Deleting offline snapshot ebcb329d-ee25-49d9-b3e0-b415d21cff72 of volume aeff195d-a9dd-4888-86c7-91dabb804bb6 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 11:53:35 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-d14b2664-4a00-450b-9528-4cf6d920c8e8 tempest-ProjectMemberTests-1275208846 None] snapshot_file for this snap is: volume-aeff195d-a9dd-4888-86c7-91dabb804bb6.ebcb329d-ee25-49d9-b3e0-b415d21cff72 {{(pid=87517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 11:53:35 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3dbaad-d3ae-4604-84c4-40b4fbe7e478]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:53:35 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d14b2664-4a00-450b-9528-4cf6d920c8e8 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6.ebcb329d-ee25-49d9-b3e0-b415d21cff72 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:35 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6.ebcb329d-ee25-49d9-b3e0-b415d21cff72 Sep 05 11:53:35 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:36 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d14b2664-4a00-450b-9528-4cf6d920c8e8 tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6.ebcb329d-ee25-49d9-b3e0-b415d21cff72" returned: 0 in 0.348s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:36 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.remotefs [None req-d14b2664-4a00-450b-9528-4cf6d920c8e8 tempest-ProjectMemberTests-1275208846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aeff195d-a9dd-4888-86c7-91dabb804bb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 11:53:36 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e540e2b-68b3-4a1d-bcd6-87155ebc8e5e]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:53:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d14b2664-4a00-450b-9528-4cf6d920c8e8 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:36 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6 Sep 05 11:53:36 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:36 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d14b2664-4a00-450b-9528-4cf6d920c8e8 tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6" returned: 0 in 0.340s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d14b2664-4a00-450b-9528-4cf6d920c8e8 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6.ebcb329d-ee25-49d9-b3e0-b415d21cff72 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:36 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6.ebcb329d-ee25-49d9-b3e0-b415d21cff72 Sep 05 11:53:36 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:36 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d14b2664-4a00-450b-9528-4cf6d920c8e8 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6.ebcb329d-ee25-49d9-b3e0-b415d21cff72" returned: 0 in 0.312s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d14b2664-4a00-450b-9528-4cf6d920c8e8 tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6.ebcb329d-ee25-49d9-b3e0-b415d21cff72 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:36 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6.ebcb329d-ee25-49d9-b3e0-b415d21cff72 Sep 05 11:53:36 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:36 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:36 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-d14b2664-4a00-450b-9528-4cf6d920c8e8 tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6.ebcb329d-ee25-49d9-b3e0-b415d21cff72" returned: 0 in 0.240s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d14b2664-4a00-450b-9528-4cf6d920c8e8 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-ebcb329d-ee25-49d9-b3e0-b415d21cff72" released by "_delete_snapshot" :: held 1.321s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:53:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d14b2664-4a00-450b-9528-4cf6d920c8e8 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-aeff195d-a9dd-4888-86c7-91dabb804bb6" released by "delete_snapshot" :: held 1.339s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:53:37 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-d14b2664-4a00-450b-9528-4cf6d920c8e8 tempest-ProjectMemberTests-1275208846 None] Created reservations ['261dceeb-b031-4c1e-a0e2-001c9ffb4a40', '3e391688-2750-47fc-aa0f-dabd0ee9f38b', '65c3e3f4-1a92-4780-90a1-68a3397d5567', '83c12a8b-437c-4d67-b097-a80060425541'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:53:37 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-d14b2664-4a00-450b-9528-4cf6d920c8e8 tempest-ProjectMemberTests-1275208846 None] Delete snapshot completed successfully. Sep 05 11:53:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-d14b2664-4a00-450b-9528-4cf6d920c8e8 tempest-ProjectMemberTests-1275208846 None] Lock "cinder-ebcb329d-ee25-49d9-b3e0-b415d21cff72-delete_snapshot" released by "delete_snapshot" :: held 1.466s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:53:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-286ff48c-7e8e-4b37-a8c5-86fc9d3427cf tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-aeff195d-a9dd-4888-86c7-91dabb804bb6-delete_volume" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:53:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-286ff48c-7e8e-4b37-a8c5-86fc9d3427cf tempest-ProjectMemberTests-1275208846 None] Lock "cinder-aeff195d-a9dd-4888-86c7-91dabb804bb6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:53:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-286ff48c-7e8e-4b37-a8c5-86fc9d3427cf tempest-ProjectMemberTests-1275208846 None] Acquiring lock "cinder-quobyte-aeff195d-a9dd-4888-86c7-91dabb804bb6" by "delete_volume" {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 11:53:37 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-286ff48c-7e8e-4b37-a8c5-86fc9d3427cf tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-aeff195d-a9dd-4888-86c7-91dabb804bb6" acquired by "delete_volume" :: waited 0.014s {{(pid=87517) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 11:53:37 devstack cinder-volume[87517]: DEBUG oslo.privsep.daemon [-] privsep: reply[177d9f35-9d85-4a0f-86af-648acb9c56f3]: (4, 'qcow2') {{(pid=88782) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 11:53:37 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-286ff48c-7e8e-4b37-a8c5-86fc9d3427cf tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:37 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6 Sep 05 11:53:37 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:38 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-286ff48c-7e8e-4b37-a8c5-86fc9d3427cf tempest-ProjectMemberTests-1275208846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6" returned: 0 in 0.349s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-286ff48c-7e8e-4b37-a8c5-86fc9d3427cf tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6 {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:38 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6 Sep 05 11:53:38 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:38 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-286ff48c-7e8e-4b37-a8c5-86fc9d3427cf tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b/volume-aeff195d-a9dd-4888-86c7-91dabb804bb6" returned: 0 in 0.243s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-286ff48c-7e8e-4b37-a8c5-86fc9d3427cf tempest-ProjectMemberTests-1275208846 None] Lock "cinder-quobyte-aeff195d-a9dd-4888-86c7-91dabb804bb6" released by "delete_volume" :: held 0.643s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:53:38 devstack cinder-volume[87517]: DEBUG cinder.quota [None req-286ff48c-7e8e-4b37-a8c5-86fc9d3427cf tempest-ProjectMemberTests-1275208846 None] Created reservations ['3385c712-4378-4af9-861a-60e5e67b3837', '909f3d4b-f3bc-408f-bd6a-1e74974ac84b', '7a7fd1b2-83c0-464d-abfd-5d7e8189bd66', '31067c72-05f3-48c5-939c-ddb6fc8abf2c'] {{(pid=87517) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 11:53:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-286ff48c-7e8e-4b37-a8c5-86fc9d3427cf tempest-ProjectMemberTests-1275208846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 11:53:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-286ff48c-7e8e-4b37-a8c5-86fc9d3427cf tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 11:53:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-286ff48c-7e8e-4b37-a8c5-86fc9d3427cf tempest-ProjectMemberTests-1275208846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32': None} {{(pid=87517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 05 11:53:38 devstack cinder-volume[87517]: DEBUG cinder.volume.drivers.quobyte [None req-286ff48c-7e8e-4b37-a8c5-86fc9d3427cf tempest-ProjectMemberTests-1275208846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-09f655cf-fe0d-4d32-98ee-ced342fc9d32'] {{(pid=87517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 05 11:53:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.lockutils [None req-286ff48c-7e8e-4b37-a8c5-86fc9d3427cf tempest-ProjectMemberTests-1275208846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 11:53:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-286ff48c-7e8e-4b37-a8c5-86fc9d3427cf tempest-ProjectMemberTests-1275208846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 11:53:38 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b Sep 05 11:53:38 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 11:53:38 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Sep 05 11:53:38 devstack cinder-volume[87517]: DEBUG oslo_concurrency.processutils [None req-286ff48c-7e8e-4b37-a8c5-86fc9d3427cf tempest-ProjectMemberTests-1275208846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ad4d340f50cf01575ba316076c48447b" returned: 0 in 0.264s {{(pid=87517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 11:53:38 devstack cinder-volume[87517]: DEBUG cinder.manager [None req-286ff48c-7e8e-4b37-a8c5-86fc9d3427cf tempest-ProjectMemberTests-1275208846 None] Notifying Schedulers of capabilities ... {{(pid=87517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 11:53:38 devstack cinder-volume[87517]: INFO cinder.volume.manager [None req-286ff48c-7e8e-4b37-a8c5-86fc9d3427cf tempest-ProjectMemberTests-1275208846 None] Deleted volume successfully. Sep 05 11:53:38 devstack cinder-volume[87517]: DEBUG cinder.coordination [None req-286ff48c-7e8e-4b37-a8c5-86fc9d3427cf tempest-ProjectMemberTests-1275208846 None] Lock "cinder-aeff195d-a9dd-4888-86c7-91dabb804bb6-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=87517) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 11:53:48 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:SELECT=112,cinder:INSERT=34,cinder:UPDATE=131,cinder:DELETE=11 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 11:53:48 devstack cinder-volume[87517]: DEBUG dbcounter [-] [87517] Writing DB stats cinder:UPDATE=146,cinder:SELECT=101,cinder:DELETE=11,cinder:INSERT=43 {{(pid=87517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}